-- Logs begin at Tue 2022-07-26 14:30:40 UTC, end at Tue 2022-07-26 15:59:44 UTC. -- Jul 26 15:23:47.350708 dv-osbrick-836062-12-ceph systemd[1]: Starting Devstack devstack@keystone.service... Jul 26 15:23:47.363269 dv-osbrick-836062-12-ceph devstack@keystone.service[87352]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 26 15:23:47.365696 dv-osbrick-836062-12-ceph devstack@keystone.service[87352]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 26 15:23:47 2022] *** Jul 26 15:23:47.365696 dv-osbrick-836062-12-ceph devstack@keystone.service[87352]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 26 15:23:47.365696 dv-osbrick-836062-12-ceph devstack@keystone.service[87352]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 26 15:23:47.365696 dv-osbrick-836062-12-ceph devstack@keystone.service[87352]: nodename: dv-osbrick-836062-12-ceph Jul 26 15:23:47.365696 dv-osbrick-836062-12-ceph devstack@keystone.service[87352]: machine: x86_64 Jul 26 15:23:47.365696 dv-osbrick-836062-12-ceph devstack@keystone.service[87352]: clock source: unix Jul 26 15:23:47.365696 dv-osbrick-836062-12-ceph devstack@keystone.service[87352]: pcre jit disabled Jul 26 15:23:47.365696 dv-osbrick-836062-12-ceph devstack@keystone.service[87352]: detected number of CPU cores: 4 Jul 26 15:23:47.365696 dv-osbrick-836062-12-ceph devstack@keystone.service[87352]: current working directory: / Jul 26 15:23:47.365696 dv-osbrick-836062-12-ceph devstack@keystone.service[87352]: detected binary path: /usr/bin/uwsgi-core Jul 26 15:23:47.365696 dv-osbrick-836062-12-ceph devstack@keystone.service[87352]: your processes number limit is 47680 Jul 26 15:23:47.365696 dv-osbrick-836062-12-ceph devstack@keystone.service[87352]: your memory page size is 4096 bytes Jul 26 15:23:47.366349 dv-osbrick-836062-12-ceph devstack@keystone.service[87352]: detected max file descriptor number: 2048 Jul 26 15:23:47.366349 dv-osbrick-836062-12-ceph devstack@keystone.service[87352]: lock engine: pthread robust mutexes Jul 26 15:23:47.366349 dv-osbrick-836062-12-ceph devstack@keystone.service[87352]: thunder lock: enabled Jul 26 15:23:47.366349 dv-osbrick-836062-12-ceph devstack@keystone.service[87352]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 26 15:23:47.366349 dv-osbrick-836062-12-ceph devstack@keystone.service[87352]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 26 15:23:47.411305 dv-osbrick-836062-12-ceph devstack@keystone.service[87352]: Python main interpreter initialized at 0x55f2c966f9c0 Jul 26 15:23:47.411305 dv-osbrick-836062-12-ceph devstack@keystone.service[87352]: python threads support enabled Jul 26 15:23:47.411305 dv-osbrick-836062-12-ceph devstack@keystone.service[87352]: your server socket listen backlog is limited to 100 connections Jul 26 15:23:47.411305 dv-osbrick-836062-12-ceph devstack@keystone.service[87352]: your mercy for graceful operations on workers is 90 seconds Jul 26 15:23:47.414288 dv-osbrick-836062-12-ceph devstack@keystone.service[87352]: mapped 403077 bytes (393 KB) for 2 cores Jul 26 15:23:47.414288 dv-osbrick-836062-12-ceph devstack@keystone.service[87352]: *** Operational MODE: preforking *** Jul 26 15:23:47.414288 dv-osbrick-836062-12-ceph devstack@keystone.service[87352]: *** uWSGI is running in multiple interpreter mode *** Jul 26 15:23:47.414288 dv-osbrick-836062-12-ceph devstack@keystone.service[87352]: spawned uWSGI master process (pid: 87352) Jul 26 15:23:47.414288 dv-osbrick-836062-12-ceph devstack@keystone.service[87352]: spawned uWSGI worker 1 (pid: 87362, cores: 1) Jul 26 15:23:47.414288 dv-osbrick-836062-12-ceph devstack@keystone.service[87352]: spawned uWSGI worker 2 (pid: 87363, cores: 1) Jul 26 15:23:47.414288 dv-osbrick-836062-12-ceph devstack@keystone.service[87352]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 26 15:23:47.412179 dv-osbrick-836062-12-ceph systemd[1]: Started Devstack devstack@keystone.service. Jul 26 15:23:53.302012 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 15:23:53.302012 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: from cryptography.utils import int_from_bytes Jul 26 15:23:53.302896 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 15:23:53.302896 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: from cryptography.utils import int_from_bytes Jul 26 15:23:53.315609 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 15:23:53.315609 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: from cryptography.utils import int_from_bytes Jul 26 15:23:53.316229 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 15:23:53.316229 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: from cryptography.utils import int_from_bytes Jul 26 15:23:53.354829 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 26 15:23:53.355014 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 26 15:23:53.355239 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] command line args: [] {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 26 15:23:53.355514 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 26 15:23:53.355696 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] ================================================================================ {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 26 15:23:53.355951 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] admin_token = **** {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:23:53.356202 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] config_dir = [] {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:23:53.356395 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:23:53.356582 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] config_source = [] {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:23:53.356766 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] debug = True {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:23:53.356974 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:23:53.358201 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:23:53.358201 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:23:53.358201 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:23:53.358201 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:23:53.358201 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] list_limit = None {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:23:53.358496 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] log_config_append = None {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:23:53.358558 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:23:53.358742 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] log_dir = None {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:23:53.358924 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] log_file = None {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:23:53.359186 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:23:53.359443 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:23:53.359695 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:23:53.359949 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:23:53.360130 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:23:53.360320 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:23:53.360568 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:23:53.360818 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:23:53.361057 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:23:53.361298 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:23:53.361569 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:23:53.361803 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:23:53.362054 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:23:53.362307 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:23:53.362586 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:23:53.363085 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:23:53.363304 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] publish_errors = False {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:23:53.363543 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:23:53.363778 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:23:53.363959 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:23:53.364209 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:23:53.364445 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:23:53.364530 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 26 15:23:53.364683 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] standard_threads = False {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:23:53.364769 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 26 15:23:53.364907 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] command line args: [] {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 26 15:23:53.364990 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:23:53.365150 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:23:53.365231 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 26 15:23:53.365330 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:23:53.365412 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] ================================================================================ {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 26 15:23:53.365511 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] use_journal = False {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:23:53.365594 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] admin_token = **** {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:23:53.365691 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] use_json = False {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:23:53.365813 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] config_dir = [] {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:23:53.365920 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] use_stderr = False {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:23:53.366043 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:23:53.366216 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] use_syslog = False {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:23:53.366360 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] config_source = [] {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:23:53.366468 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:23:53.366567 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] debug = True {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:23:53.366674 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.366776 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:23:53.366893 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.366976 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:23:53.366976 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:23:53.367115 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.367244 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:23:53.367335 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.367537 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:23:53.367645 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.367734 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] list_limit = None {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:23:53.367823 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.367915 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] log_config_append = None {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:23:53.368026 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.368122 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:23:53.368227 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.368333 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] log_dir = None {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:23:53.368424 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] log_file = None {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:23:53.368521 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.368616 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:23:53.368726 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.368820 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:23:53.368910 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.369094 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:23:53.369188 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.369329 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:23:53.369429 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.369517 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:23:53.369620 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.369702 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:23:53.369868 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.370072 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:23:53.370261 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.370458 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:23:53.370656 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.370842 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:23:53.371037 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.371278 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:23:53.371417 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.371539 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:23:53.371679 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.371800 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:23:53.371800 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:23:53.372021 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.372142 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:23:53.372262 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.372262 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.372505 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:23:53.372629 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.372629 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.372851 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:23:53.372851 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] publish_errors = False {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:23:53.373059 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.373131 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:23:53.373260 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.373370 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:23:53.373466 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.373554 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:23:53.373629 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.373629 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.373803 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:23:53.373927 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.374057 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:23:53.374155 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.374227 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] standard_threads = False {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:23:53.374294 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.374367 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:23:53.374436 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.374581 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:23:53.374655 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.374729 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:23:53.374798 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.374877 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] use_journal = False {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:23:53.375047 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] use_json = False {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:23:53.375173 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.375279 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] use_stderr = False {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:23:53.375366 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.375443 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] use_syslog = False {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:23:53.375517 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.375685 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:23:53.375778 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.375948 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.376026 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.376194 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.376269 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.376428 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.376514 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.376662 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.376737 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.376900 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.376977 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.377236 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.377320 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.377517 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.377607 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.377772 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.377849 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.378003 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.378089 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.378244 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.378320 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.378491 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.378581 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.378741 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.378828 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.378972 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.379053 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.379234 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.379314 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.379474 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.379553 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.379713 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.379794 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.379951 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.380034 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.380191 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.380270 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.380429 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.380507 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.380681 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.380763 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.380920 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.380997 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.381160 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.381238 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.381394 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.381482 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.381657 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.381735 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.381896 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.381975 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.382128 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.382204 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.382357 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.382433 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.382587 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.382666 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.382823 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.382900 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.383076 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.383193 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.383351 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.383431 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.383582 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.383680 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.383837 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.383953 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.384042 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.384123 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.384279 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.384359 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.384532 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.384611 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.384774 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.384859 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.385004 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.385081 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.385238 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.385316 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.385483 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.385585 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.385726 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.385811 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.385966 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.386044 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.386193 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.386271 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.386422 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.386501 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.386658 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.386815 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.386891 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.386962 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.387160 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.387299 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.387422 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.387567 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.387703 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.387835 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.387835 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.388083 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.388235 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.388357 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.388484 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.388619 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.388751 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.388886 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.389011 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.389145 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.389276 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.389409 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.389547 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.389680 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.389807 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.389932 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.390057 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.390189 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.390319 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.390444 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.390578 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.390711 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.390837 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.390969 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.390969 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.391230 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.391356 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.391491 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.391617 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.391752 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.391884 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.392009 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] auth.external = None {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.392133 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.392258 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.392392 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.392524 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.392658 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.393450 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.393601 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.393729 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] auth.password = None {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.393861 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.393995 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] auth.token = None {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.394127 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.394252 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.394383 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.394509 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.394634 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.394779 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.394904 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.395029 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.395227 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.395351 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.395476 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.395612 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.395734 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.395859 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.395981 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.396106 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] credential.caching = True {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.396231 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.396363 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.396489 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.396623 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.396749 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.396873 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.396987 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.397171 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.397297 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.397424 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.397562 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.397685 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.397822 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.397948 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.398080 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.398206 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.398347 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.398498 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.398639 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.398766 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.398899 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.399025 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.399166 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.399244 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.399315 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.399315 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.399452 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.399525 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.399600 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.399671 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.399740 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.399809 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.399884 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] federation.caching = True {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.399956 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.400025 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.400094 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.400162 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.400231 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.400307 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.400378 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.400447 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.400515 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.400583 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.400652 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.400792 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.400867 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.400937 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.401006 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.401075 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.401144 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.401221 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.401293 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] auth.external = None {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.401361 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.401430 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.401499 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.401586 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.401655 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] identity.caching = True {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.401768 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.401875 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.401998 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] auth.password = None {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.402134 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.402212 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] auth.token = None {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.402379 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.402465 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.402616 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.402694 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.402867 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.402945 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.403101 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.403216 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.403365 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.403455 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.403617 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.403695 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.403848 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.403927 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.404082 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] credential.caching = True {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.404159 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.404314 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.404390 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.404549 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.404632 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.404790 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.404868 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.405025 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.405110 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.405267 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.405352 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.405501 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.405599 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.405757 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.405837 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.406007 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.406085 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.406243 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.406321 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.406486 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.406563 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.406721 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.406800 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.406961 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.407044 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.407215 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.407309 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.407456 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.407534 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.407700 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.407777 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.407943 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.408027 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] federation.caching = True {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.408191 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.408268 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.408959 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.409092 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.409220 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.409343 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.409470 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.409574 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.409707 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.409821 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.409954 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.410060 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.410204 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.410313 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.410442 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.410549 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.410691 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.410803 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.410925 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.411035 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.411189 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.411306 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.411429 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.411543 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] identity.caching = True {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.411676 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.411918 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.411995 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.412159 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.412236 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.412412 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.412490 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.412660 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.412739 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.412894 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.412985 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.413127 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.413206 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.413365 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.413442 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.413616 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.413693 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.413854 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.413932 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.414094 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.414178 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.414332 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.414411 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.414564 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] ldap.user = None {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.414644 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.414807 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.414892 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.415053 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.415177 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.415318 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.415398 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.415569 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.415647 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.415819 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.415897 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.416070 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.416149 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.416309 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.416386 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.416541 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.416618 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.416771 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.416855 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.417005 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.417082 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.417232 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.417308 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.417464 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.417541 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.417702 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.417780 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.417943 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.418021 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.418188 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.418266 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.418415 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.418492 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.418662 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.418741 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.418890 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.418968 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.419145 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.419227 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.419388 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.419465 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.419644 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.419726 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.419855 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.419932 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.420089 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.420174 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.420584 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.420673 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.420833 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.420912 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.421070 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.421155 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.421327 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.421405 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.421559 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.421636 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.421791 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.421876 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.422031 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.422108 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.422269 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.422347 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.422496 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.422580 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.422729 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.422807 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.422976 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.423054 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.423246 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.423339 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.423485 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.423564 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.423729 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] resource.caching = True {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.423806 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.424011 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.424166 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.424241 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] ldap.user = None {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.424311 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.424492 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.424570 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.424749 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.424835 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.425002 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.425080 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.425240 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.425319 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.425490 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.425576 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.425730 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.425808 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.425963 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.426040 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.426192 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.426277 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] role.caching = True {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.426429 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.426507 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] role.driver = sql {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.426660 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.426737 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.426893 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.426982 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.427196 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.427278 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.427419 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.427497 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.427664 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.427753 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.427910 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.427987 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.428154 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.428231 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.428399 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.428485 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.428627 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.428705 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.428870 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.428947 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.429106 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.429191 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.429340 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.429418 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.429575 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.429653 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.429809 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.429895 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.430053 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.430241 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.430319 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.430481 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.430560 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.430740 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.430820 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.430977 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.431053 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.431245 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.431341 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.431483 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.431562 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.431721 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.431798 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.431979 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.432064 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.432232 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.432316 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.432471 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.432548 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.432700 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.432786 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.432932 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.433009 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.433166 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.433243 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] resource.caching = True {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.433413 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.433498 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.433668 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.433781 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.433903 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.433994 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.434140 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.434240 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.434382 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.434483 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.434612 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.434691 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.434846 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] token.caching = True {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.434936 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.435081 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.435182 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.435355 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.435435 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.435591 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] role.caching = True {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.435683 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.435895 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.436145 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.436385 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.436631 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.436895 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] role.driver = sql {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.436983 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.437252 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.437368 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.437668 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.437809 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.438006 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.438096 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.438330 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.438417 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.438626 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.438715 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.438876 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.438967 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.439121 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.439223 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.439505 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.439654 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.439794 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.439893 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.440033 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.440114 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] database.connection = **** {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.440312 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.440400 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.440568 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.440649 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.440813 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.440895 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.441061 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.441141 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.441303 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.441489 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.441581 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.441729 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.441809 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.441982 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.442062 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.442236 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.442334 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.442485 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.442564 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.442733 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.442812 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.442974 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.443071 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.443248 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.443331 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.443490 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.443570 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.443738 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.443832 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.443971 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.444051 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.444215 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.444295 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.444453 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.444542 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.444616 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 26 15:23:53.444758 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.445013 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.445295 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.445546 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.445775 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.446006 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.446244 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] token.caching = True {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.446480 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.446805 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.446997 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.447279 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.447528 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.447798 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.448043 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.448286 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.448531 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.448768 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.449040 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.449303 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.449549 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.449807 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.450036 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.450279 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.450576 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.450835 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] database.connection = **** {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.451080 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.451352 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.451591 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.451871 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.452110 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.452347 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.452585 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.452824 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.453068 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.453302 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.453546 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.453779 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.454023 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.454257 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.454544 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.454776 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.455018 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.455826 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:23:53.456000 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 26 15:23:53.474810 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:23:53.475039 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:23:53.475300 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:23:53.482658 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:23:53.482922 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:23:53.483171 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:23:53.483824 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:23:53.491774 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:23:53.513266 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:23:53.513495 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:23:53.518763 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:23:53.519003 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:23:53.567438 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:23:53.569836 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:23:53.618684 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:23:53.618925 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:23:53.620265 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:23:53.620503 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:23:53.685696 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:23:53.685911 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:23:53.686006 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:23:53.686142 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:23:53.686225 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:23:53.686365 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:23:53.686449 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:23:53.686590 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:23:53.686673 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:23:53.686810 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:23:53.686891 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:23:53.687021 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:23:53.711444 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:23:53.711694 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:23:53.711822 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:23:53.711954 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:23:53.712102 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:23:53.712216 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:23:53.712339 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:23:53.712461 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:23:53.712578 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:23:53.712716 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:23:53.712873 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:23:53.712984 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:23:53.713104 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:23:53.713104 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:23:53.724071 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:23:53.724616 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:23:53.737158 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:23:53.737386 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:23:53.737618 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:23:53.737727 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:23:53.737828 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:23:53.737905 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:23:53.738050 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:23:53.738133 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:23:53.738268 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:23:53.738358 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:23:53.738487 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:23:53.738585 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:23:53.738741 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:23:53.738957 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:23:53.756143 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.756353 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 26 15:23:53.756701 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.756783 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.756907 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 26 15:23:53.756989 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 26 15:23:53.757183 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.757266 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.757430 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 26 15:23:53.757511 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.757696 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.757788 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.757953 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.758034 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.758245 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.758500 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.768375 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.768661 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.768937 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.769064 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.769222 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.769346 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.769646 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.769930 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.777383 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=87363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 15:23:53.778357 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=87362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 15:23:53.780454 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=87363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 15:23:53.780733 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.781011 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.781288 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.781372 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=87362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 15:23:53.781575 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.781658 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.781843 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.781927 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.782109 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.782193 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.782393 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.782486 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.782669 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.782751 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.782942 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.783024 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.783896 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.784065 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.784510 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.784794 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.785069 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.809488 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.811011 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 15:23:53.811319 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.812911 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.814483 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 15:23:53.814801 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.816066 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=87362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 15:23:53.816351 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.816747 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.819697 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=87363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 15:23:53.819954 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.820245 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.823603 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=87362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 15:23:53.823892 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.827052 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=87363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 15:23:53.827360 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.828121 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 15:23:53.828411 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.828705 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.829105 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.829409 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.829689 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.829963 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.830267 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.831745 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 15:23:53.832031 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.832309 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.832590 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.832872 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.833265 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.833554 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.833857 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.846975 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.847289 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.850522 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.850802 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.851278 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 15:23:53.854449 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.854780 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 15:23:53.854866 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.858248 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.858545 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.859249 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 15:23:53.863033 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 15:23:53.863910 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 15:23:53.866255 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.866561 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.868995 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.869991 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 15:23:53.870107 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.870107 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.870107 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.876190 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.876190 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.876190 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.876190 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.876190 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.876190 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.884261 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 15:23:53.884564 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.884833 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.885099 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.889891 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 15:23:53.890184 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.890452 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.890713 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.892107 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.893845 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.894129 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.896888 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=87362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 15:23:53.897176 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.897466 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.897750 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.897847 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.898034 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.899526 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.899812 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.902566 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=87363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 15:23:53.902852 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.903158 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.903437 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.903718 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.910165 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=87362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 15:23:53.910449 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.910737 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.911023 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.911337 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.911623 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.911898 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.916019 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=87363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 15:23:53.916295 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.916614 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.916878 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.917153 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.917425 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.917733 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.928722 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=87362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 15:23:53.931813 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 15:23:53.934758 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=87363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 15:23:53.936022 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.937519 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.937920 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 15:23:53.939044 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=87362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 15:23:53.939353 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.939671 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.941096 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.942719 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.944193 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=87363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 15:23:53.944475 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.944765 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.951924 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.953533 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=87363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 15:23:53.956867 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.957200 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.957484 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.957760 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.966282 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 15:23:53.966580 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.966858 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.974730 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=87363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 15:23:53.975204 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.975501 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.975825 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.976107 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.976402 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.976664 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.976944 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.977221 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.977560 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.977844 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.978113 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.978378 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:53.978639 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:54.015761 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55f2c966f9c0 pid: 87363 (default app) Jul 26 15:23:54.020469 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb44ed-ad9d-4098-af63-47377420b7c8 None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:54.020762 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb44ed-ad9d-4098-af63-47377420b7c8 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:54.021097 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb44ed-ad9d-4098-af63-47377420b7c8 None None] PATH_INFO: `/v3` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:54.025830 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 1/1] 10.222.0.18 () {50 vars in 791 bytes} [Tue Jul 26 15:23:54 2022] GET /identity/v3/ => generated 255 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:23:54.046654 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:54.048213 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=87362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 15:23:54.051848 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:54.052143 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:54.052430 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:54.052713 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:54.060894 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 15:23:54.061188 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:54.061483 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:54.069285 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=87362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 15:23:54.069585 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:54.069926 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:54.070167 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:54.070440 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:54.070725 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:54.071005 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:54.071328 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:54.071614 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:54.071883 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:54.072158 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:54.072436 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:54.072706 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:54.072972 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:23:54.106821 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55f2c966f9c0 pid: 87362 (default app) Jul 26 15:24:03.810529 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f98cf-c1e0-4ba1-9959-0c1a6ffc6651 None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:03.811062 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f98cf-c1e0-4ba1-9959-0c1a6ffc6651 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:03.811251 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f98cf-c1e0-4ba1-9959-0c1a6ffc6651 None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:03.812670 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 2/2] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:24:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:24:03.821065 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ee648-a04b-4b05-a2dd-c22b3c1a4751 None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:03.821541 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ee648-a04b-4b05-a2dd-c22b3c1a4751 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:03.821671 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ee648-a04b-4b05-a2dd-c22b3c1a4751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:03.899755 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: INFO dbcounter [None req-ed1ee648-a04b-4b05-a2dd-c22b3c1a4751 None None] Registered counter for database keystone Jul 26 15:24:03.930577 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG oslo_db.sqlalchemy.engines [None req-ed1ee648-a04b-4b05-a2dd-c22b3c1a4751 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87362) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 15:24:03.938083 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writer thread running {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 15:24:04.145214 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG passlib.handlers.bcrypt [None req-ed1ee648-a04b-4b05-a2dd-c22b3c1a4751 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=87362) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 26 15:24:04.145711 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG passlib.handlers.bcrypt [None req-ed1ee648-a04b-4b05-a2dd-c22b3c1a4751 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87362) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 26 15:24:04.234020 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-ed1ee648-a04b-4b05-a2dd-c22b3c1a4751 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:24:04.235713 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-ed1ee648-a04b-4b05-a2dd-c22b3c1a4751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:04.531502 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 1/3] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:24:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 714 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 26 15:24:04.604118 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5f98cf-c1e0-4ba1-9959-0c1a6ffc6651 None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:04.726504 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: INFO dbcounter [None req-7c5f98cf-c1e0-4ba1-9959-0c1a6ffc6651 None None] Registered counter for database keystone Jul 26 15:24:04.756089 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG oslo_db.sqlalchemy.engines [None req-7c5f98cf-c1e0-4ba1-9959-0c1a6ffc6651 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87363) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 15:24:04.762512 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writer thread running {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 15:24:04.989925 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5f98cf-c1e0-4ba1-9959-0c1a6ffc6651 None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:04.994448 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2756e60c-1a5d-431e-acf7-c776e08de424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1316e00006b74e70a667f12420c63a2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:04.995139 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756e60c-1a5d-431e-acf7-c776e08de424 admin admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:04.995434 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756e60c-1a5d-431e-acf7-c776e08de424 admin admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:04.995712 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756e60c-1a5d-431e-acf7-c776e08de424 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:05.005415 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2756e60c-1a5d-431e-acf7-c776e08de424 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:05.056828 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: WARNING keystone.common.rbac_enforcer.enforcer [None req-2756e60c-1a5d-431e-acf7-c776e08de424 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 26 15:24:05.057164 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2756e60c-1a5d-431e-acf7-c776e08de424 admin admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:05.068342 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 3/4] 10.222.0.18 () {58 vars in 1324 bytes} [Tue Jul 26 15:24:04 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 15:24:05.074905 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1ee648-a04b-4b05-a2dd-c22b3c1a4751 None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:05.091785 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1ee648-a04b-4b05-a2dd-c22b3c1a4751 None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:05.097612 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a44f0c-38c8-46bb-8fbc-21724d117d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1316e00006b74e70a667f12420c63a2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:05.098797 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a44f0c-38c8-46bb-8fbc-21724d117d69 admin admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:05.099097 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a44f0c-38c8-46bb-8fbc-21724d117d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:05.099416 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a44f0c-38c8-46bb-8fbc-21724d117d69 admin admin] PATH_INFO: `/v3/projects/1316e00006b74e70a667f12420c63a2c` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:05.101236 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a44f0c-38c8-46bb-8fbc-21724d117d69 admin admin] RBAC: Authorizing `identity:get_project(project_id=1316e00006b74e70a667f12420c63a2c)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:05.153406 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: WARNING keystone.common.rbac_enforcer.enforcer [None req-02a44f0c-38c8-46bb-8fbc-21724d117d69 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 26 15:24:05.153759 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a44f0c-38c8-46bb-8fbc-21724d117d69 admin admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:05.159088 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 2/5] 10.222.0.18 () {56 vars in 1207 bytes} [Tue Jul 26 15:24:05 2022] GET /identity/v3/projects/1316e00006b74e70a667f12420c63a2c => generated 344 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:24:07.551278 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fa59c0-ebae-4591-a034-e2d107b6bfd0 None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:07.551933 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fa59c0-ebae-4591-a034-e2d107b6bfd0 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:07.552243 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fa59c0-ebae-4591-a034-e2d107b6bfd0 None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:07.560770 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 4/6] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:24:07 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 15:24:07.568787 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae299a-b542-47c0-b2a9-f68998dd4e1c None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:07.569533 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae299a-b542-47c0-b2a9-f68998dd4e1c None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:07.569716 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae299a-b542-47c0-b2a9-f68998dd4e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:07.592733 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-16ae299a-b542-47c0-b2a9-f68998dd4e1c None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:24:07.594310 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-16ae299a-b542-47c0-b2a9-f68998dd4e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:07.603832 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 3/7] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:24:07 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 26 15:24:07.630251 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fa59c0-ebae-4591-a034-e2d107b6bfd0 None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:07.649625 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fa59c0-ebae-4591-a034-e2d107b6bfd0 None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:07.668640 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c95ad9-5758-4061-b328-0f6f6318a87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1316e00006b74e70a667f12420c63a2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:07.669596 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c95ad9-5758-4061-b328-0f6f6318a87f admin admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:07.670288 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c95ad9-5758-4061-b328-0f6f6318a87f admin admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:07.670739 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c95ad9-5758-4061-b328-0f6f6318a87f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:07.685665 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c95ad9-5758-4061-b328-0f6f6318a87f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:07.689048 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c95ad9-5758-4061-b328-0f6f6318a87f admin admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:07.706329 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 5/8] 10.222.0.18 () {58 vars in 1324 bytes} [Tue Jul 26 15:24:07 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 15:24:07.714456 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ae299a-b542-47c0-b2a9-f68998dd4e1c None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:07.731455 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ae299a-b542-47c0-b2a9-f68998dd4e1c None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:07.737331 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65507a01-697d-49e8-a082-ee222aa09f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1316e00006b74e70a667f12420c63a2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:07.738106 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65507a01-697d-49e8-a082-ee222aa09f89 admin admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:07.738491 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65507a01-697d-49e8-a082-ee222aa09f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:07.738850 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65507a01-697d-49e8-a082-ee222aa09f89 admin admin] PATH_INFO: `/v3/users/18673fd27512449ab07302f33ac3c310` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:07.741351 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65507a01-697d-49e8-a082-ee222aa09f89 admin admin] RBAC: Authorizing `identity:get_user(user_id=18673fd27512449ab07302f33ac3c310)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:07.743420 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65507a01-697d-49e8-a082-ee222aa09f89 admin admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:07.747191 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 4/9] 10.222.0.18 () {56 vars in 1198 bytes} [Tue Jul 26 15:24:07 2022] GET /identity/v3/users/18673fd27512449ab07302f33ac3c310 => generated 247 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:24:10.377076 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee4167-e1ab-4b53-97cc-36b947bb2191 None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:10.377669 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee4167-e1ab-4b53-97cc-36b947bb2191 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:10.378052 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee4167-e1ab-4b53-97cc-36b947bb2191 None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:10.380620 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 6/10] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:24:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:24:10.388956 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a64ec9a-9adc-4204-9c70-e38f245f5f74 None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:10.389757 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a64ec9a-9adc-4204-9c70-e38f245f5f74 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:10.389927 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a64ec9a-9adc-4204-9c70-e38f245f5f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:10.406179 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be8c35-fd5d-4c6b-8206-7198402b1786 None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:10.406628 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be8c35-fd5d-4c6b-8206-7198402b1786 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:10.407090 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be8c35-fd5d-4c6b-8206-7198402b1786 None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:10.409156 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 7/11] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:24:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 15:24:10.416389 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-3a64ec9a-9adc-4204-9c70-e38f245f5f74 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:24:10.417796 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0114b342-b4f2-4adb-b47a-3706bb284145 None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:10.418264 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0114b342-b4f2-4adb-b47a-3706bb284145 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:10.418407 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-3a64ec9a-9adc-4204-9c70-e38f245f5f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:10.418711 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0114b342-b4f2-4adb-b47a-3706bb284145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:10.491343 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG passlib.handlers.bcrypt [None req-0114b342-b4f2-4adb-b47a-3706bb284145 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=87363) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 26 15:24:10.496596 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG passlib.handlers.bcrypt [None req-0114b342-b4f2-4adb-b47a-3706bb284145 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87363) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 26 15:24:10.544677 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-0114b342-b4f2-4adb-b47a-3706bb284145 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:24:10.547430 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-0114b342-b4f2-4adb-b47a-3706bb284145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:10.557642 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 5/12] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:24:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:24:10.585443 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a64ec9a-9adc-4204-9c70-e38f245f5f74 None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:10.627592 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:10.677740 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 8/13] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:24:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 15:24:10.705663 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0114b342-b4f2-4adb-b47a-3706bb284145 None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:10.735214 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a64ec9a-9adc-4204-9c70-e38f245f5f74 None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:10.773964 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6190eb7b-ca92-41aa-b872-841d628e8f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:10.774822 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6190eb7b-ca92-41aa-b872-841d628e8f16 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:10.775314 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6190eb7b-ca92-41aa-b872-841d628e8f16 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:10.775701 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6190eb7b-ca92-41aa-b872-841d628e8f16 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:10.790096 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6190eb7b-ca92-41aa-b872-841d628e8f16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:24:10.800347 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application [None req-6190eb7b-ca92-41aa-b872-841d628e8f16 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 15:24:10.800347 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:24:10.800347 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:24:10.800347 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:24:10.800347 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:24:10.800347 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:24:10.800347 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:24:10.800347 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:24:10.800347 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:24:10.800347 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:24:10.800347 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:24:10.800347 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:24:10.800347 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:24:10.800347 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:24:10.800347 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:24:10.800347 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:24:10.801748 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:24:10.801748 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:24:10.801748 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:24:10.801748 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:24:10.801748 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:24:10.801748 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:24:10.801748 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:24:10.801748 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:24:10.801748 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:24:10.801748 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:24:10.801748 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:24:10.801748 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application with Lock( Jul 26 15:24:10.801748 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:24:10.801748 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:24:10.801748 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:24:10.801748 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:24:10.803084 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:24:10.803084 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:24:10.803084 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:24:10.803084 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:24:10.803084 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:24:10.803084 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:24:10.803084 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:24:10.803084 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:24:10.803084 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:24:10.803084 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:24:10.803084 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 15:24:10.803084 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:24:10.803084 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 6/14] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jul 26 15:24:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:24:10.810989 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6190eb7b-ca92-41aa-b872-841d628e8f16 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:10.838032 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0114b342-b4f2-4adb-b47a-3706bb284145 None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:10.842520 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:10.893163 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76ab319-4664-4535-938a-d06524a8e4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:10.893970 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ab319-4664-4535-938a-d06524a8e4e9 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:10.894257 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ab319-4664-4535-938a-d06524a8e4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:10.894537 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ab319-4664-4535-938a-d06524a8e4e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:10.904699 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:10.925146 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6190eb7b-ca92-41aa-b872-841d628e8f16 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:10.966515 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11ac578-c610-4885-a1af-9b47cc5a44bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:10.967529 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ac578-c610-4885-a1af-9b47cc5a44bb None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:10.967973 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ac578-c610-4885-a1af-9b47cc5a44bb None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:10.968422 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ac578-c610-4885-a1af-9b47cc5a44bb None admin] PATH_INFO: `/v3/roles` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:10.969408 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11ac578-c610-4885-a1af-9b47cc5a44bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:24:10.969721 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11ac578-c610-4885-a1af-9b47cc5a44bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:10.971759 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11ac578-c610-4885-a1af-9b47cc5a44bb None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:10.988773 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 7/15] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 15:24:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:24:10.991120 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76ab319-4664-4535-938a-d06524a8e4e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:10.992793 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76ab319-4664-4535-938a-d06524a8e4e9 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:10.994791 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11ac578-c610-4885-a1af-9b47cc5a44bb None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:11.126939 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11ac578-c610-4885-a1af-9b47cc5a44bb None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:11.142284 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 9/16] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 15:24:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 26 15:24:11.149182 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76ab319-4664-4535-938a-d06524a8e4e9 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:11.153899 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:11.170335 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5316cb56-2013-492e-bcb4-e1eba338acf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:11.171010 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316cb56-2013-492e-bcb4-e1eba338acf5 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:11.171335 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316cb56-2013-492e-bcb4-e1eba338acf5 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:11.171620 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316cb56-2013-492e-bcb4-e1eba338acf5 None admin] PATH_INFO: `/v3/users/18673fd27512449ab07302f33ac3c310` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:11.173086 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5316cb56-2013-492e-bcb4-e1eba338acf5 None admin] RBAC: Authorizing `identity:get_user(user_id=18673fd27512449ab07302f33ac3c310)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:11.175187 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5316cb56-2013-492e-bcb4-e1eba338acf5 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:11.176978 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 8/17] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 26 15:24:10 2022] GET /identity/v3/users/18673fd27512449ab07302f33ac3c310 => generated 247 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:24:11.182834 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5316cb56-2013-492e-bcb4-e1eba338acf5 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:11.199587 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:11.303464 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76ab319-4664-4535-938a-d06524a8e4e9 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:11.305256 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5316cb56-2013-492e-bcb4-e1eba338acf5 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:11.347397 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3addf38d-9371-470d-96fe-335ce7cedd02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:11.348543 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3addf38d-9371-470d-96fe-335ce7cedd02 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:11.349005 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3addf38d-9371-470d-96fe-335ce7cedd02 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:11.349423 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fe64fd-f69e-4ba3-99c5-eeef3ece8ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:11.349545 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3addf38d-9371-470d-96fe-335ce7cedd02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:11.350079 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe64fd-f69e-4ba3-99c5-eeef3ece8ff5 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:11.350359 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe64fd-f69e-4ba3-99c5-eeef3ece8ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:11.350643 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe64fd-f69e-4ba3-99c5-eeef3ece8ff5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:11.352102 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fe64fd-f69e-4ba3-99c5-eeef3ece8ff5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:11.353578 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fe64fd-f69e-4ba3-99c5-eeef3ece8ff5 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:11.355395 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 9/18] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 15:24:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:24:11.363484 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fe64fd-f69e-4ba3-99c5-eeef3ece8ff5 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:11.383058 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3addf38d-9371-470d-96fe-335ce7cedd02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:11.386033 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3addf38d-9371-470d-96fe-335ce7cedd02 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:11.407162 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-3addf38d-9371-470d-96fe-335ce7cedd02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:24:11.407162 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:24:11.407162 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:24:11.407162 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:24:11.407162 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:24:11.407162 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:24:11.407162 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:24:11.407162 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:24:11.407162 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:24:11.407162 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:24:11.407162 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:24:11.407162 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:24:11.407162 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:24:11.407162 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:24:11.407162 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:24:11.408083 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:24:11.408083 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:24:11.408083 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:24:11.408083 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:24:11.408083 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:24:11.408083 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:24:11.408083 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:24:11.408083 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:24:11.408083 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:24:11.408083 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:24:11.408083 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:24:11.408083 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:24:11.408083 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:24:11.408083 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:24:11.408083 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:24:11.408083 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:24:11.408083 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:24:11.414226 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:24:11.414226 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:24:11.414226 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:24:11.414226 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:24:11.414226 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 10/19] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 15:24:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 15:24:11.415064 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3addf38d-9371-470d-96fe-335ce7cedd02 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:11.472567 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:11.482475 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:11.496530 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fe64fd-f69e-4ba3-99c5-eeef3ece8ff5 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:11.537507 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3addf38d-9371-470d-96fe-335ce7cedd02 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:11.552229 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca87b2c8-2937-4c15-9d6d-d6fb83deddfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:11.552931 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca87b2c8-2937-4c15-9d6d-d6fb83deddfc None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:11.553650 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca87b2c8-2937-4c15-9d6d-d6fb83deddfc None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:11.553939 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca87b2c8-2937-4c15-9d6d-d6fb83deddfc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:11.554793 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca87b2c8-2937-4c15-9d6d-d6fb83deddfc None admin] RBAC: Adding query filter params (role.id=2c659645e15c4204b1457556939397cb, scope.domain.id=default, user.id=18673fd27512449ab07302f33ac3c310) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:24:11.555115 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca87b2c8-2937-4c15-9d6d-d6fb83deddfc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:11.556680 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca87b2c8-2937-4c15-9d6d-d6fb83deddfc None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:11.565267 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 10/20] 10.222.0.18 () {56 vars in 1322 bytes} [Tue Jul 26 15:24:11 2022] GET /identity/v3/role_assignments?user.id=18673fd27512449ab07302f33ac3c310&scope.domain.id=default&role.id=2c659645e15c4204b1457556939397cb => generated 233 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:24:11.588803 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992d1443-9dd1-434c-9547-43825b94812d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:11.589929 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992d1443-9dd1-434c-9547-43825b94812d None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:11.590430 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992d1443-9dd1-434c-9547-43825b94812d None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:11.590944 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992d1443-9dd1-434c-9547-43825b94812d None admin] PATH_INFO: `/v3/domains` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:11.592428 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992d1443-9dd1-434c-9547-43825b94812d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:24:11.592971 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992d1443-9dd1-434c-9547-43825b94812d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:11.595775 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992d1443-9dd1-434c-9547-43825b94812d None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:11.623626 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 11/21] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 15:24:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:24:14.568721 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfaa6c4-eed9-42e6-a81e-99bf10ba5dcb None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:14.569295 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfaa6c4-eed9-42e6-a81e-99bf10ba5dcb None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:14.569748 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfaa6c4-eed9-42e6-a81e-99bf10ba5dcb None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:14.572470 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 11/22] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:24:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:24:14.578653 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c57bcc-0ad7-49e9-abe8-054f48a4b6a9 None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:14.580163 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c57bcc-0ad7-49e9-abe8-054f48a4b6a9 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:14.580662 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c57bcc-0ad7-49e9-abe8-054f48a4b6a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:14.611699 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-93c57bcc-0ad7-49e9-abe8-054f48a4b6a9 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:24:14.613273 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-93c57bcc-0ad7-49e9-abe8-054f48a4b6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:14.717567 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 12/23] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:24:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:24:14.754164 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfaa6c4-eed9-42e6-a81e-99bf10ba5dcb None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:14.832631 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd8389-0570-4480-a270-99aba5e29f84 None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:14.833553 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd8389-0570-4480-a270-99aba5e29f84 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:14.834039 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd8389-0570-4480-a270-99aba5e29f84 None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:14.835892 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 13/24] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:24:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 15:24:14.846728 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4510493-9d6c-417f-aa56-126842571fa6 None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:14.847629 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4510493-9d6c-417f-aa56-126842571fa6 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:14.848147 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4510493-9d6c-417f-aa56-126842571fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:14.911880 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-a4510493-9d6c-417f-aa56-126842571fa6 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:24:14.913876 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-a4510493-9d6c-417f-aa56-126842571fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:15.067841 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:15.097628 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfaa6c4-eed9-42e6-a81e-99bf10ba5dcb None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:15.120841 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 14/25] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:24:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 26 15:24:15.124648 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096c4ccb-7fbe-40d1-8e6b-ac2ddb28f8e6 None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:15.125013 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096c4ccb-7fbe-40d1-8e6b-ac2ddb28f8e6 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:15.125347 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096c4ccb-7fbe-40d1-8e6b-ac2ddb28f8e6 None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:15.127854 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 15/26] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:24:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:24:15.135382 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a170ccb9-aeab-43fa-9f82-46415dcea8dd None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:15.135756 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a170ccb9-aeab-43fa-9f82-46415dcea8dd None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:15.136121 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a170ccb9-aeab-43fa-9f82-46415dcea8dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:15.185902 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-a170ccb9-aeab-43fa-9f82-46415dcea8dd None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:24:15.187400 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-a170ccb9-aeab-43fa-9f82-46415dcea8dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:15.193857 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da2b28b-dfb8-410e-a164-5edfd27fc784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:15.194681 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da2b28b-dfb8-410e-a164-5edfd27fc784 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:15.195001 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da2b28b-dfb8-410e-a164-5edfd27fc784 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:15.196319 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da2b28b-dfb8-410e-a164-5edfd27fc784 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:15.220268 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da2b28b-dfb8-410e-a164-5edfd27fc784 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:15.221800 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da2b28b-dfb8-410e-a164-5edfd27fc784 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:15.228193 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:15.246863 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application [None req-4da2b28b-dfb8-410e-a164-5edfd27fc784 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:24:15.246863 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:24:15.246863 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:24:15.246863 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:24:15.246863 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:24:15.246863 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:24:15.246863 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:24:15.246863 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:24:15.246863 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:24:15.246863 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:24:15.246863 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:24:15.246863 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:24:15.246863 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:24:15.246863 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:24:15.246863 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:24:15.248506 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:24:15.248506 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:24:15.248506 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:24:15.248506 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:24:15.248506 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:24:15.248506 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:24:15.248506 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:24:15.248506 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:24:15.248506 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application with Lock( Jul 26 15:24:15.248506 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:24:15.248506 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:24:15.248506 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:24:15.248506 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:24:15.248506 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:24:15.248506 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:24:15.248506 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:24:15.248506 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:24:15.249606 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:24:15.249606 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:24:15.249606 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:24:15.249606 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:24:15.249606 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 12/27] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 15:24:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 496 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:24:15.249873 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da2b28b-dfb8-410e-a164-5edfd27fc784 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:15.369227 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 16/28] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:24:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:24:15.369939 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a170ccb9-aeab-43fa-9f82-46415dcea8dd None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:15.490814 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a170ccb9-aeab-43fa-9f82-46415dcea8dd None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:15.500358 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:15.518610 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da2b28b-dfb8-410e-a164-5edfd27fc784 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:15.532933 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ae6903-408d-4881-8ec3-1b1b4ece25cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:15.534194 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae6903-408d-4881-8ec3-1b1b4ece25cb None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:15.534194 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae6903-408d-4881-8ec3-1b1b4ece25cb None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:15.534194 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae6903-408d-4881-8ec3-1b1b4ece25cb None admin] PATH_INFO: `/v3/domains` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:15.534691 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ae6903-408d-4881-8ec3-1b1b4ece25cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:24:15.535451 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ae6903-408d-4881-8ec3-1b1b4ece25cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:15.537306 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ae6903-408d-4881-8ec3-1b1b4ece25cb None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:15.551167 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 17/29] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 15:24:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:24:15.552138 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ae6903-408d-4881-8ec3-1b1b4ece25cb None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:15.589136 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01032c11-7b34-42b7-9113-e650f0515645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:15.590512 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01032c11-7b34-42b7-9113-e650f0515645 None admin] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:15.591001 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01032c11-7b34-42b7-9113-e650f0515645 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:15.591497 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01032c11-7b34-42b7-9113-e650f0515645 None admin] PATH_INFO: `/v3/roles` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:15.592543 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01032c11-7b34-42b7-9113-e650f0515645 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:15.594221 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01032c11-7b34-42b7-9113-e650f0515645 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:15.673989 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ae6903-408d-4881-8ec3-1b1b4ece25cb None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:15.716177 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba58cde8-1d1d-4e8c-a49a-745cc0cf10d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:15.716929 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba58cde8-1d1d-4e8c-a49a-745cc0cf10d7 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:15.717220 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba58cde8-1d1d-4e8c-a49a-745cc0cf10d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:15.717503 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba58cde8-1d1d-4e8c-a49a-745cc0cf10d7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:15.733572 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba58cde8-1d1d-4e8c-a49a-745cc0cf10d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:24:15.740371 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-ba58cde8-1d1d-4e8c-a49a-745cc0cf10d7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 15:24:15.740371 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:24:15.740371 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:24:15.740371 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:24:15.740371 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:24:15.740371 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:24:15.740371 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:24:15.740371 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:24:15.740371 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:24:15.740371 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:24:15.740371 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:24:15.740371 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:24:15.740371 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:24:15.740371 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:24:15.740371 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:24:15.740371 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:24:15.741282 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:24:15.741282 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:24:15.741282 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:24:15.741282 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:24:15.741282 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:24:15.741282 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:24:15.741282 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:24:15.741282 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:24:15.741282 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:24:15.741282 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:24:15.741282 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:24:15.741282 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:24:15.741282 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:24:15.741282 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:24:15.741282 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:24:15.741282 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:24:15.742042 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:24:15.742042 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:24:15.742042 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:24:15.742042 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:24:15.742042 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:24:15.742042 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:24:15.742042 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:24:15.742042 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:24:15.742042 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:24:15.742042 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:24:15.742042 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 15:24:15.742042 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:24:15.742042 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 18/30] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jul 26 15:24:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:24:15.742679 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba58cde8-1d1d-4e8c-a49a-745cc0cf10d7 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:15.776376 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:15.867183 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba58cde8-1d1d-4e8c-a49a-745cc0cf10d7 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:15.907170 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41a9c74-c79d-431e-8513-c719a40710ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:15.907170 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a9c74-c79d-431e-8513-c719a40710ed None admin] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:15.907170 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a9c74-c79d-431e-8513-c719a40710ed None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:15.907170 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a9c74-c79d-431e-8513-c719a40710ed None admin] PATH_INFO: `/v3/projects` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:15.910369 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41a9c74-c79d-431e-8513-c719a40710ed None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:15.911999 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41a9c74-c79d-431e-8513-c719a40710ed None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:15.969322 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 13/31] 10.222.0.18 () {60 vars in 1131 bytes} [Tue Jul 26 15:24:15 2022] POST /identity/v3/roles => generated 219 bytes in 720 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:24:15.971200 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01032c11-7b34-42b7-9113-e650f0515645 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:16.107564 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:16.158216 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01032c11-7b34-42b7-9113-e650f0515645 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:16.203292 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e12a30f-78c7-4841-906d-ef1cb1ab49b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:16.203292 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e12a30f-78c7-4841-906d-ef1cb1ab49b6 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:16.203292 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e12a30f-78c7-4841-906d-ef1cb1ab49b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:16.203292 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e12a30f-78c7-4841-906d-ef1cb1ab49b6 None admin] PATH_INFO: `/v3/roles` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:16.203666 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e12a30f-78c7-4841-906d-ef1cb1ab49b6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:24:16.203666 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e12a30f-78c7-4841-906d-ef1cb1ab49b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:16.203666 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e12a30f-78c7-4841-906d-ef1cb1ab49b6 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:16.211242 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 14/32] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 15:24:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:24:16.212628 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c03c65-7329-4b13-98f3-1f0bdc271e22 None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:16.212924 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c03c65-7329-4b13-98f3-1f0bdc271e22 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:16.213209 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c03c65-7329-4b13-98f3-1f0bdc271e22 None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:16.214472 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 15/33] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:24:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:24:16.219288 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c03c65-7329-4b13-98f3-1f0bdc271e22 None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:16.269498 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 19/34] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Jul 26 15:24:15 2022] POST /identity/v3/projects => generated 301 bytes in 527 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:24:16.271217 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4c9ac7-2743-4876-9752-1978b2c8a606 None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:16.271516 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4c9ac7-2743-4876-9752-1978b2c8a606 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:16.271803 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4c9ac7-2743-4876-9752-1978b2c8a606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:16.294126 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-2a4c9ac7-2743-4876-9752-1978b2c8a606 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:24:16.296010 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-2a4c9ac7-2743-4876-9752-1978b2c8a606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:16.389248 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 20/35] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:24:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:24:16.390635 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e653c-2acc-48d4-89b5-e3b41a951dda None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:16.390931 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e653c-2acc-48d4-89b5-e3b41a951dda None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:16.391302 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e653c-2acc-48d4-89b5-e3b41a951dda None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:16.393307 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 21/36] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:24:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:24:16.415633 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ba1b2-561f-4bc0-bcd2-8ee7a11dab15 None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:16.415983 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ba1b2-561f-4bc0-bcd2-8ee7a11dab15 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:16.416277 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ba1b2-561f-4bc0-bcd2-8ee7a11dab15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:16.417047 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c03c65-7329-4b13-98f3-1f0bdc271e22 None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:16.443552 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:16.459781 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-a53ba1b2-561f-4bc0-bcd2-8ee7a11dab15 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:24:16.459781 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-a53ba1b2-561f-4bc0-bcd2-8ee7a11dab15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:16.459781 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:16.472757 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13db66e-f4f4-4d41-8041-d755ab42e901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:16.473451 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13db66e-f4f4-4d41-8041-d755ab42e901 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:16.473738 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13db66e-f4f4-4d41-8041-d755ab42e901 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:16.474021 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13db66e-f4f4-4d41-8041-d755ab42e901 None admin] PATH_INFO: `/v3/users/18673fd27512449ab07302f33ac3c310` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:16.476797 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13db66e-f4f4-4d41-8041-d755ab42e901 None admin] RBAC: Authorizing `identity:get_user(user_id=18673fd27512449ab07302f33ac3c310)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:16.478451 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13db66e-f4f4-4d41-8041-d755ab42e901 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:16.485484 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 16/37] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 26 15:24:16 2022] GET /identity/v3/users/18673fd27512449ab07302f33ac3c310 => generated 247 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:24:16.486636 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13db66e-f4f4-4d41-8041-d755ab42e901 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:16.573962 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 22/38] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:24:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 15:24:16.575340 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53ba1b2-561f-4bc0-bcd2-8ee7a11dab15 None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:16.622636 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13db66e-f4f4-4d41-8041-d755ab42e901 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:16.673564 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f8b463-470c-4339-81dd-287839dea582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:16.674211 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f8b463-470c-4339-81dd-287839dea582 None admin] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:16.674499 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f8b463-470c-4339-81dd-287839dea582 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:16.674786 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f8b463-470c-4339-81dd-287839dea582 None admin] PATH_INFO: `/v3/roles` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:16.675589 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f8b463-470c-4339-81dd-287839dea582 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:16.677065 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f8b463-470c-4339-81dd-287839dea582 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:16.715547 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53ba1b2-561f-4bc0-bcd2-8ee7a11dab15 None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:16.750388 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0868db-e7e7-48d1-b1f7-b4dbdda9d9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:16.751073 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0868db-e7e7-48d1-b1f7-b4dbdda9d9ae None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:16.751393 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0868db-e7e7-48d1-b1f7-b4dbdda9d9ae None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:16.751673 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0868db-e7e7-48d1-b1f7-b4dbdda9d9ae None admin] PATH_INFO: `/v3/domains/default` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:16.753125 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0868db-e7e7-48d1-b1f7-b4dbdda9d9ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:16.754741 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0868db-e7e7-48d1-b1f7-b4dbdda9d9ae None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:16.756378 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 23/39] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 15:24:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:24:16.757130 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0868db-e7e7-48d1-b1f7-b4dbdda9d9ae None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:16.770167 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:16.816087 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 17/40] 10.222.0.18 () {60 vars in 1131 bytes} [Tue Jul 26 15:24:16 2022] POST /identity/v3/roles => generated 223 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:24:16.817338 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f8b463-470c-4339-81dd-287839dea582 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:16.881871 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0868db-e7e7-48d1-b1f7-b4dbdda9d9ae None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:16.885833 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:16.922395 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14bd093-ec97-4219-bd12-848c51178a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:16.923455 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14bd093-ec97-4219-bd12-848c51178a63 None admin] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:16.923748 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14bd093-ec97-4219-bd12-848c51178a63 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:16.924034 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14bd093-ec97-4219-bd12-848c51178a63 None admin] PATH_INFO: `/v3/roles` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:16.924784 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14bd093-ec97-4219-bd12-848c51178a63 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:16.926286 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14bd093-ec97-4219-bd12-848c51178a63 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:16.953371 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f8b463-470c-4339-81dd-287839dea582 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:16.991022 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0584b652-8ec1-4f43-b736-005b113b6961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:16.991697 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0584b652-8ec1-4f43-b736-005b113b6961 None admin] REQUEST_METHOD: `PUT` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:16.991991 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0584b652-8ec1-4f43-b736-005b113b6961 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:16.992289 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0584b652-8ec1-4f43-b736-005b113b6961 None admin] PATH_INFO: `/v3/domains/default/users/18673fd27512449ab07302f33ac3c310/roles/2c659645e15c4204b1457556939397cb` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:16.994548 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0584b652-8ec1-4f43-b736-005b113b6961 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=18673fd27512449ab07302f33ac3c310, role_id=2c659645e15c4204b1457556939397cb)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:16.996049 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0584b652-8ec1-4f43-b736-005b113b6961 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:17.046171 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 24/41] 10.222.0.18 () {60 vars in 1131 bytes} [Tue Jul 26 15:24:16 2022] POST /identity/v3/roles => generated 225 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:24:17.047491 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b97cb-17e1-4c24-897d-401049fa8923 None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:17.047791 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b97cb-17e1-4c24-897d-401049fa8923 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:17.048082 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b97cb-17e1-4c24-897d-401049fa8923 None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:17.051820 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 25/42] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:24:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:24:17.057439 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38451981-ba4f-4785-9946-949b07ccfb92 None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:17.057795 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38451981-ba4f-4785-9946-949b07ccfb92 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:17.058122 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38451981-ba4f-4785-9946-949b07ccfb92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:17.085571 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-38451981-ba4f-4785-9946-949b07ccfb92 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:24:17.086829 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-38451981-ba4f-4785-9946-949b07ccfb92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:17.101008 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 18/43] 10.222.0.18 () {58 vars in 1361 bytes} [Tue Jul 26 15:24:16 2022] PUT /identity/v3/domains/default/users/18673fd27512449ab07302f33ac3c310/roles/2c659645e15c4204b1457556939397cb => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:24:17.166314 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:17.177115 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 26/44] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:24:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 15:24:17.201446 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0584b652-8ec1-4f43-b736-005b113b6961 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:17.322493 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0584b652-8ec1-4f43-b736-005b113b6961 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:17.330349 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:17.357200 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b9097d-07c6-4fdc-aead-98f83bf8210d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:17.357850 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b9097d-07c6-4fdc-aead-98f83bf8210d None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:17.358142 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b9097d-07c6-4fdc-aead-98f83bf8210d None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:17.358427 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b9097d-07c6-4fdc-aead-98f83bf8210d None admin] PATH_INFO: `/v3/domains/default` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:17.359625 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b9097d-07c6-4fdc-aead-98f83bf8210d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:17.362143 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b9097d-07c6-4fdc-aead-98f83bf8210d None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:17.363763 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 19/45] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 15:24:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:24:17.369426 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38451981-ba4f-4785-9946-949b07ccfb92 None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:17.467477 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38451981-ba4f-4785-9946-949b07ccfb92 None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:17.501770 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5e1e70-19df-467e-b546-e1fd984b092a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:17.502395 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e1e70-19df-467e-b546-e1fd984b092a None admin] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:17.502685 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e1e70-19df-467e-b546-e1fd984b092a None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:17.502969 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e1e70-19df-467e-b546-e1fd984b092a None admin] PATH_INFO: `/v3/projects` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:17.503707 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5e1e70-19df-467e-b546-e1fd984b092a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:17.505204 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5e1e70-19df-467e-b546-e1fd984b092a None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:17.605033 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 27/46] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Jul 26 15:24:17 2022] POST /identity/v3/projects => generated 312 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:24:19.377410 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed6722d-9e3f-4323-80a4-1ed2fbe5607b None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:19.377936 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed6722d-9e3f-4323-80a4-1ed2fbe5607b None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:19.378079 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed6722d-9e3f-4323-80a4-1ed2fbe5607b None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:19.379453 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 20/47] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:24:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:24:19.385545 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa2ddf-4c94-40a4-bcac-b23cbedddbb4 None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:19.386018 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa2ddf-4c94-40a4-bcac-b23cbedddbb4 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:19.386122 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa2ddf-4c94-40a4-bcac-b23cbedddbb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:19.405343 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-94aa2ddf-4c94-40a4-bcac-b23cbedddbb4 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:24:19.406552 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-94aa2ddf-4c94-40a4-bcac-b23cbedddbb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:19.458140 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:19.484389 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 28/48] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:24:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:24:19.509102 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed6722d-9e3f-4323-80a4-1ed2fbe5607b None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:19.619121 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed6722d-9e3f-4323-80a4-1ed2fbe5607b None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:19.655297 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57a9a20-7e40-4ca3-8a45-901c6571999b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:19.655872 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a9a20-7e40-4ca3-8a45-901c6571999b None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:19.656166 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a9a20-7e40-4ca3-8a45-901c6571999b None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:19.656446 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a9a20-7e40-4ca3-8a45-901c6571999b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:19.668042 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57a9a20-7e40-4ca3-8a45-901c6571999b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:24:19.674656 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application [None req-f57a9a20-7e40-4ca3-8a45-901c6571999b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 15:24:19.674656 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:24:19.674656 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:24:19.674656 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:24:19.674656 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:24:19.674656 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:24:19.674656 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:24:19.674656 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:24:19.674656 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:24:19.674656 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:24:19.674656 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:24:19.674656 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:24:19.674656 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:24:19.674656 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:24:19.674656 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:24:19.674656 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:24:19.678518 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:24:19.678518 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:24:19.678518 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:24:19.678518 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:24:19.678518 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:24:19.678518 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:24:19.678518 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:24:19.678518 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:24:19.678518 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:24:19.678518 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:24:19.678518 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:24:19.678518 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application with Lock( Jul 26 15:24:19.678518 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:24:19.678518 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:24:19.678518 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:24:19.678518 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:24:19.679333 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:24:19.679333 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:24:19.679333 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:24:19.679333 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:24:19.679333 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:24:19.679333 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:24:19.679333 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:24:19.679333 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:24:19.679333 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:24:19.679333 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:24:19.679333 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 15:24:19.679333 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:24:19.679333 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 21/49] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jul 26 15:24:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:24:19.682481 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aa2ddf-4c94-40a4-bcac-b23cbedddbb4 None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:19.796815 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aa2ddf-4c94-40a4-bcac-b23cbedddbb4 None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:19.834336 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9f507b-e6dc-4217-94c5-db06a8f96583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:19.834969 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f507b-e6dc-4217-94c5-db06a8f96583 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:19.835297 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f507b-e6dc-4217-94c5-db06a8f96583 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:19.835582 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f507b-e6dc-4217-94c5-db06a8f96583 None admin] PATH_INFO: `/v3/roles` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:19.836321 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9f507b-e6dc-4217-94c5-db06a8f96583 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:24:19.836634 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9f507b-e6dc-4217-94c5-db06a8f96583 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:19.837569 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e05e4d-918d-4b1b-800b-289286f2f175 None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:19.837859 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e05e4d-918d-4b1b-800b-289286f2f175 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:19.838144 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e05e4d-918d-4b1b-800b-289286f2f175 None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:19.838294 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9f507b-e6dc-4217-94c5-db06a8f96583 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:19.839710 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 22/50] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:24:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 15:24:19.845492 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2894a66d-7e56-4823-995b-f4cd5ca01be7 None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:19.845784 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2894a66d-7e56-4823-995b-f4cd5ca01be7 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:19.846957 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2894a66d-7e56-4823-995b-f4cd5ca01be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:19.851393 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 29/51] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 15:24:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:24:19.857195 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9f507b-e6dc-4217-94c5-db06a8f96583 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:19.865067 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-2894a66d-7e56-4823-995b-f4cd5ca01be7 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:24:19.866623 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-2894a66d-7e56-4823-995b-f4cd5ca01be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:19.896844 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:19.904300 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:19.948319 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 23/52] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:24:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 15:24:19.971119 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9f507b-e6dc-4217-94c5-db06a8f96583 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:19.972578 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2894a66d-7e56-4823-995b-f4cd5ca01be7 None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:20.010056 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f2c65f-20b6-4a8d-a217-536d3783acc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:20.010720 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f2c65f-20b6-4a8d-a217-536d3783acc3 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:20.011007 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f2c65f-20b6-4a8d-a217-536d3783acc3 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:20.011343 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f2c65f-20b6-4a8d-a217-536d3783acc3 None admin] PATH_INFO: `/v3/users/18673fd27512449ab07302f33ac3c310` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:20.012801 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f2c65f-20b6-4a8d-a217-536d3783acc3 None admin] RBAC: Authorizing `identity:get_user(user_id=18673fd27512449ab07302f33ac3c310)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:20.014358 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f2c65f-20b6-4a8d-a217-536d3783acc3 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:20.019291 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 30/53] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 26 15:24:19 2022] GET /identity/v3/users/18673fd27512449ab07302f33ac3c310 => generated 247 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:24:20.023345 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f2c65f-20b6-4a8d-a217-536d3783acc3 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:20.084440 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2894a66d-7e56-4823-995b-f4cd5ca01be7 None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:20.119150 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae789e3f-1054-44d8-924a-ff54ca03c59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:20.119819 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae789e3f-1054-44d8-924a-ff54ca03c59b None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:20.120106 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae789e3f-1054-44d8-924a-ff54ca03c59b None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:20.120403 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae789e3f-1054-44d8-924a-ff54ca03c59b None admin] PATH_INFO: `/v3/domains/default` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:20.121585 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae789e3f-1054-44d8-924a-ff54ca03c59b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:20.123059 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae789e3f-1054-44d8-924a-ff54ca03c59b None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:20.124716 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 24/54] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 15:24:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:24:20.131216 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae789e3f-1054-44d8-924a-ff54ca03c59b None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:20.137929 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f2c65f-20b6-4a8d-a217-536d3783acc3 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:20.148013 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:20.169173 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:20.185467 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0240912-3cd2-42b7-b914-174c92daae5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:20.187368 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0240912-3cd2-42b7-b914-174c92daae5a None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:20.187368 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0240912-3cd2-42b7-b914-174c92daae5a None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:20.187368 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0240912-3cd2-42b7-b914-174c92daae5a None admin] PATH_INFO: `/v3/domains/default` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:20.189106 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0240912-3cd2-42b7-b914-174c92daae5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:20.190788 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0240912-3cd2-42b7-b914-174c92daae5a None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:20.193343 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 31/55] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 15:24:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:24:20.198825 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0240912-3cd2-42b7-b914-174c92daae5a None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:20.261058 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae789e3f-1054-44d8-924a-ff54ca03c59b None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:20.300938 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f9917c-15fa-4eed-968f-3bf872f9ec06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:20.301963 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9917c-15fa-4eed-968f-3bf872f9ec06 None admin] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:20.302451 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9917c-15fa-4eed-968f-3bf872f9ec06 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:20.302883 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9917c-15fa-4eed-968f-3bf872f9ec06 None admin] PATH_INFO: `/v3/projects` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:20.304102 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f9917c-15fa-4eed-968f-3bf872f9ec06 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:20.306683 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f9917c-15fa-4eed-968f-3bf872f9ec06 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:20.324510 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0240912-3cd2-42b7-b914-174c92daae5a None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:20.361217 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9613f558-aa05-454d-b851-cc122f17783a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:20.361855 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9613f558-aa05-454d-b851-cc122f17783a None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:20.362147 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9613f558-aa05-454d-b851-cc122f17783a None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:20.362433 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9613f558-aa05-454d-b851-cc122f17783a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:20.363328 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9613f558-aa05-454d-b851-cc122f17783a None admin] RBAC: Adding query filter params (role.id=2c659645e15c4204b1457556939397cb, scope.domain.id=default, user.id=18673fd27512449ab07302f33ac3c310) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:24:20.363650 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9613f558-aa05-454d-b851-cc122f17783a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:20.365217 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9613f558-aa05-454d-b851-cc122f17783a None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:20.375333 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 32/56] 10.222.0.18 () {56 vars in 1322 bytes} [Tue Jul 26 15:24:20 2022] GET /identity/v3/role_assignments?user.id=18673fd27512449ab07302f33ac3c310&scope.domain.id=default&role.id=2c659645e15c4204b1457556939397cb => generated 530 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:24:20.440813 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 25/57] 10.222.0.18 () {60 vars in 1140 bytes} [Tue Jul 26 15:24:20 2022] POST /identity/v3/projects => generated 298 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:24:22.813291 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6850e203-94db-48e0-92f6-abf85f30816a None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:22.813878 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6850e203-94db-48e0-92f6-abf85f30816a None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:22.813878 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6850e203-94db-48e0-92f6-abf85f30816a None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:22.815406 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 33/58] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:24:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 15:24:22.821043 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1697367d-6fcc-465e-9a89-6a2ab01ca5a3 None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:22.821544 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1697367d-6fcc-465e-9a89-6a2ab01ca5a3 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:22.821702 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1697367d-6fcc-465e-9a89-6a2ab01ca5a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:22.841912 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-1697367d-6fcc-465e-9a89-6a2ab01ca5a3 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:24:22.843232 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-1697367d-6fcc-465e-9a89-6a2ab01ca5a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:22.921679 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 26/59] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:24:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:24:22.950302 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6850e203-94db-48e0-92f6-abf85f30816a None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:23.003928 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:23.069147 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6850e203-94db-48e0-92f6-abf85f30816a None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:23.119844 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea855048-2a1c-4017-8928-d943944b9643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:23.120949 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea855048-2a1c-4017-8928-d943944b9643 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:23.121456 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea855048-2a1c-4017-8928-d943944b9643 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:23.121954 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea855048-2a1c-4017-8928-d943944b9643 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:23.124087 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea855048-2a1c-4017-8928-d943944b9643 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:23.126904 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea855048-2a1c-4017-8928-d943944b9643 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:23.129805 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 34/60] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 15:24:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:24:23.135681 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1697367d-6fcc-465e-9a89-6a2ab01ca5a3 None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:23.151392 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:23.239509 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1697367d-6fcc-465e-9a89-6a2ab01ca5a3 None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:23.282092 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9cd72b-0cdc-4dee-8f92-3da1f2443f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:23.282724 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9cd72b-0cdc-4dee-8f92-3da1f2443f08 None admin] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:23.283002 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9cd72b-0cdc-4dee-8f92-3da1f2443f08 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:23.283335 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9cd72b-0cdc-4dee-8f92-3da1f2443f08 None admin] PATH_INFO: `/v3/users` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:23.284038 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9cd72b-0cdc-4dee-8f92-3da1f2443f08 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:23.285502 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9cd72b-0cdc-4dee-8f92-3da1f2443f08 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:23.415287 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 27/61] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Jul 26 15:24:23 2022] POST /identity/v3/users => generated 275 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:24:27.229825 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9318ee19-1f92-4fbf-a143-e0ce439157c0 None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:27.231439 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9318ee19-1f92-4fbf-a143-e0ce439157c0 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:27.232278 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9318ee19-1f92-4fbf-a143-e0ce439157c0 None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:27.235948 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 35/62] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:24:27 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:24:27.256254 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3073cd3-0ee4-49c4-93ba-a8b273bfa0e1 None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:27.257715 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3073cd3-0ee4-49c4-93ba-a8b273bfa0e1 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:27.258483 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3073cd3-0ee4-49c4-93ba-a8b273bfa0e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:27.301276 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-a3073cd3-0ee4-49c4-93ba-a8b273bfa0e1 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:24:27.302706 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-a3073cd3-0ee4-49c4-93ba-a8b273bfa0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:27.386907 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:27.401935 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 28/63] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:24:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:24:27.482929 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9318ee19-1f92-4fbf-a143-e0ce439157c0 None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:27.756135 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9318ee19-1f92-4fbf-a143-e0ce439157c0 None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:27.783828 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:27.832637 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2657bdc1-5475-493e-8b33-2c64f39aec5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:27.833867 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2657bdc1-5475-493e-8b33-2c64f39aec5d None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:27.834493 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2657bdc1-5475-493e-8b33-2c64f39aec5d None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:27.835212 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2657bdc1-5475-493e-8b33-2c64f39aec5d None admin] PATH_INFO: `/v3/roles/member` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:27.865059 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2657bdc1-5475-493e-8b33-2c64f39aec5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:24:27.876573 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-2657bdc1-5475-493e-8b33-2c64f39aec5d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 15:24:27.876573 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:24:27.876573 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:24:27.876573 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:24:27.876573 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:24:27.876573 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:24:27.876573 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:24:27.876573 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:24:27.876573 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:24:27.876573 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:24:27.876573 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:24:27.876573 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:24:27.876573 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:24:27.876573 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:24:27.876573 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:24:27.876573 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:24:27.882113 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:24:27.882113 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:24:27.882113 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:24:27.882113 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:24:27.882113 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:24:27.882113 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:24:27.882113 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:24:27.882113 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:24:27.882113 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:24:27.882113 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:24:27.882113 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:24:27.882113 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:24:27.882113 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:24:27.882113 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:24:27.882113 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:24:27.882113 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:24:27.883942 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:24:27.883942 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:24:27.883942 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:24:27.883942 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:24:27.883942 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:24:27.883942 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:24:27.883942 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:24:27.883942 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:24:27.883942 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:24:27.883942 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:24:27.883942 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 15:24:27.883942 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:24:27.889807 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6abb1e7-f1a3-434d-8fe5-36eb7a1e1a69 None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:27.889807 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6abb1e7-f1a3-434d-8fe5-36eb7a1e1a69 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:27.890404 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 36/64] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 15:24:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 399 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:24:27.890634 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6abb1e7-f1a3-434d-8fe5-36eb7a1e1a69 None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:27.890634 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 29/65] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:24:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:24:27.891643 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2657bdc1-5475-493e-8b33-2c64f39aec5d None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:27.913944 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaabaa8-d1b3-4eea-8360-02f7e4040146 None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:27.914458 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaabaa8-d1b3-4eea-8360-02f7e4040146 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:27.914966 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaabaa8-d1b3-4eea-8360-02f7e4040146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:27.997813 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-4aaabaa8-d1b3-4eea-8360-02f7e4040146 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:24:28.000650 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-4aaabaa8-d1b3-4eea-8360-02f7e4040146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:28.066173 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2657bdc1-5475-493e-8b33-2c64f39aec5d None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:28.115802 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 30/66] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:24:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:24:28.117878 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad21d77-ef2d-403b-8e70-f40c002f1055 None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:28.118519 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad21d77-ef2d-403b-8e70-f40c002f1055 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:28.118947 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad21d77-ef2d-403b-8e70-f40c002f1055 None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:28.124595 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 31/67] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:24:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:24:28.125367 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ed8e1e-393a-4f3b-af93-e74581574409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:28.126030 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae1cd67-334e-4e3f-b849-5cba41ffec84 None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:28.136194 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae1cd67-334e-4e3f-b849-5cba41ffec84 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:28.136194 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae1cd67-334e-4e3f-b849-5cba41ffec84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:28.136482 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed8e1e-393a-4f3b-af93-e74581574409 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:28.136482 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed8e1e-393a-4f3b-af93-e74581574409 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:28.136482 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed8e1e-393a-4f3b-af93-e74581574409 None admin] PATH_INFO: `/v3/roles` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:28.136482 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ed8e1e-393a-4f3b-af93-e74581574409 None admin] RBAC: Adding query filter params (name=member) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:24:28.136482 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ed8e1e-393a-4f3b-af93-e74581574409 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:28.136482 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ed8e1e-393a-4f3b-af93-e74581574409 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:28.147507 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-7ae1cd67-334e-4e3f-b849-5cba41ffec84 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:24:28.148824 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-7ae1cd67-334e-4e3f-b849-5cba41ffec84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:28.152333 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 37/68] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jul 26 15:24:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:24:28.164895 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ed8e1e-393a-4f3b-af93-e74581574409 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:28.226999 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:28.242507 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 32/69] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:24:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:24:28.247547 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae1cd67-334e-4e3f-b849-5cba41ffec84 None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:28.346898 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ed8e1e-393a-4f3b-af93-e74581574409 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:28.372717 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:28.400269 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280d8dc5-89f2-4a19-ac14-24d1963a824c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:28.401448 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d8dc5-89f2-4a19-ac14-24d1963a824c None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:28.401981 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d8dc5-89f2-4a19-ac14-24d1963a824c None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:28.402477 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d8dc5-89f2-4a19-ac14-24d1963a824c None admin] PATH_INFO: `/v3/users/d861ca5a090d4492861528dc158b6822` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:28.427324 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280d8dc5-89f2-4a19-ac14-24d1963a824c None admin] RBAC: Authorizing `identity:get_user(user_id=d861ca5a090d4492861528dc158b6822)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:28.429566 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280d8dc5-89f2-4a19-ac14-24d1963a824c None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:28.432610 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 38/70] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 26 15:24:28 2022] GET /identity/v3/users/d861ca5a090d4492861528dc158b6822 => generated 275 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:24:28.433699 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280d8dc5-89f2-4a19-ac14-24d1963a824c None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:28.447420 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae1cd67-334e-4e3f-b849-5cba41ffec84 None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:28.512078 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8b1784-9b3f-43ca-8e43-b52be75c3fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:28.513644 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b1784-9b3f-43ca-8e43-b52be75c3fc4 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:28.514528 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b1784-9b3f-43ca-8e43-b52be75c3fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:28.515314 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b1784-9b3f-43ca-8e43-b52be75c3fc4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:28.545041 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8b1784-9b3f-43ca-8e43-b52be75c3fc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:24:28.559099 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application [None req-ce8b1784-9b3f-43ca-8e43-b52be75c3fc4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 15:24:28.559099 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:24:28.559099 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:24:28.559099 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:24:28.559099 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:24:28.559099 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:24:28.559099 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:24:28.559099 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:24:28.559099 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:24:28.559099 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:24:28.559099 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:24:28.559099 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:24:28.559099 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:24:28.559099 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:24:28.559099 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:24:28.559099 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:24:28.561091 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:24:28.561091 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:24:28.561091 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:24:28.561091 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:24:28.561091 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:24:28.561091 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:24:28.561091 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:24:28.561091 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:24:28.561091 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:24:28.561091 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:24:28.561091 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:24:28.561091 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application with Lock( Jul 26 15:24:28.561091 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:24:28.561091 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:24:28.561091 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:24:28.561091 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:24:28.563950 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:24:28.563950 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:24:28.563950 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:24:28.563950 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:24:28.563950 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:24:28.563950 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:24:28.563950 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:24:28.563950 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:24:28.563950 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:24:28.563950 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:24:28.563950 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 15:24:28.563950 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:24:28.568266 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:28.575758 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 33/71] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jul 26 15:24:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:24:28.575758 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8b1784-9b3f-43ca-8e43-b52be75c3fc4 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:28.601508 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280d8dc5-89f2-4a19-ac14-24d1963a824c None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:28.654398 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738fa2f2-87f8-4f77-8966-ab9e2f3509e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:28.655458 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738fa2f2-87f8-4f77-8966-ab9e2f3509e3 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:28.655880 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738fa2f2-87f8-4f77-8966-ab9e2f3509e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:28.656348 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738fa2f2-87f8-4f77-8966-ab9e2f3509e3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:28.671846 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738fa2f2-87f8-4f77-8966-ab9e2f3509e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:24:28.678712 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-738fa2f2-87f8-4f77-8966-ab9e2f3509e3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 15:24:28.678712 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:24:28.678712 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:24:28.678712 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:24:28.678712 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:24:28.678712 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:24:28.678712 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:24:28.678712 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:24:28.678712 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:24:28.678712 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:24:28.678712 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:24:28.678712 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:24:28.678712 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:24:28.678712 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:24:28.678712 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:24:28.678712 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:24:28.680486 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:24:28.680486 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:24:28.680486 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:24:28.680486 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:24:28.680486 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:24:28.680486 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:24:28.680486 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:24:28.680486 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:24:28.680486 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:24:28.680486 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:24:28.680486 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:24:28.680486 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:24:28.680486 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:24:28.680486 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:24:28.680486 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:24:28.680486 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:24:28.681382 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:24:28.681382 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:24:28.681382 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:24:28.681382 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:24:28.681382 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:24:28.681382 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:24:28.681382 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:24:28.681382 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:24:28.681382 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:24:28.681382 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:24:28.681382 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 15:24:28.681382 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:24:28.681382 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 39/72] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jul 26 15:24:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:24:28.682082 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738fa2f2-87f8-4f77-8966-ab9e2f3509e3 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:28.734253 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8b1784-9b3f-43ca-8e43-b52be75c3fc4 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:28.764609 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:28.787884 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b50105-b377-4362-88a4-0bf088552e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:28.788876 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b50105-b377-4362-88a4-0bf088552e16 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:28.789224 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b50105-b377-4362-88a4-0bf088552e16 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:28.789549 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b50105-b377-4362-88a4-0bf088552e16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:28.818112 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738fa2f2-87f8-4f77-8966-ab9e2f3509e3 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:28.857660 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ea515c-8fde-4321-81fa-080051623e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:28.858199 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ea515c-8fde-4321-81fa-080051623e52 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:28.858548 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ea515c-8fde-4321-81fa-080051623e52 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:28.858836 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ea515c-8fde-4321-81fa-080051623e52 None admin] PATH_INFO: `/v3/roles` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:28.859641 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ea515c-8fde-4321-81fa-080051623e52 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:24:28.859959 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ea515c-8fde-4321-81fa-080051623e52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:28.861433 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ea515c-8fde-4321-81fa-080051623e52 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:28.870662 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 40/73] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 15:24:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:24:28.871984 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e1fd29-d3eb-4305-a771-e4a0eaa8332c None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:28.872277 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e1fd29-d3eb-4305-a771-e4a0eaa8332c None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:28.872563 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e1fd29-d3eb-4305-a771-e4a0eaa8332c None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:28.874127 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 41/74] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:24:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:24:28.879210 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3454fff6-6a68-4314-b429-ea6de45060eb None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:28.879547 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3454fff6-6a68-4314-b429-ea6de45060eb None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:28.879786 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3454fff6-6a68-4314-b429-ea6de45060eb None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:28.881137 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 42/75] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:24:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:24:28.881870 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3454fff6-6a68-4314-b429-ea6de45060eb None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:28.889996 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b50105-b377-4362-88a4-0bf088552e16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:28.893357 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b50105-b377-4362-88a4-0bf088552e16 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:28.897316 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:29.018376 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3454fff6-6a68-4314-b429-ea6de45060eb None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:29.042593 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 34/76] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 15:24:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 15:24:29.043733 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b50105-b377-4362-88a4-0bf088552e16 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:29.069127 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:29.073833 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e18fc08-f221-4087-ac29-1a49bc48551f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:29.074471 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e18fc08-f221-4087-ac29-1a49bc48551f None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:29.074759 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e18fc08-f221-4087-ac29-1a49bc48551f None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:29.075042 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e18fc08-f221-4087-ac29-1a49bc48551f None admin] PATH_INFO: `/v3/roles` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:29.075819 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e18fc08-f221-4087-ac29-1a49bc48551f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:24:29.076128 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e18fc08-f221-4087-ac29-1a49bc48551f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:29.077587 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e18fc08-f221-4087-ac29-1a49bc48551f None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:29.088479 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 43/77] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 15:24:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:24:29.089843 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f064ad-3f5d-4267-aaa0-57e1c8e2ab72 None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:29.090148 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f064ad-3f5d-4267-aaa0-57e1c8e2ab72 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:29.090417 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f064ad-3f5d-4267-aaa0-57e1c8e2ab72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:29.110142 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-17f064ad-3f5d-4267-aaa0-57e1c8e2ab72 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:24:29.111425 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-17f064ad-3f5d-4267-aaa0-57e1c8e2ab72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:29.174461 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b50105-b377-4362-88a4-0bf088552e16 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:29.206868 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 44/78] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:24:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:24:29.209200 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd891aaa-8c3d-47a9-897d-0a82703b94d7 None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:29.209691 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd891aaa-8c3d-47a9-897d-0a82703b94d7 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:29.210237 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd891aaa-8c3d-47a9-897d-0a82703b94d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:29.211667 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404115db-e10f-42b0-9c62-7fe17d1c9f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:29.212341 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404115db-e10f-42b0-9c62-7fe17d1c9f76 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:29.212634 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404115db-e10f-42b0-9c62-7fe17d1c9f76 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:29.212917 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404115db-e10f-42b0-9c62-7fe17d1c9f76 None admin] PATH_INFO: `/v3/users/18673fd27512449ab07302f33ac3c310` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:29.214185 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404115db-e10f-42b0-9c62-7fe17d1c9f76 None admin] RBAC: Authorizing `identity:get_user(user_id=18673fd27512449ab07302f33ac3c310)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:29.215771 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404115db-e10f-42b0-9c62-7fe17d1c9f76 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:29.223385 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 35/79] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 26 15:24:29 2022] GET /identity/v3/users/18673fd27512449ab07302f33ac3c310 => generated 247 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:24:29.223385 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404115db-e10f-42b0-9c62-7fe17d1c9f76 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:29.223581 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:29.238213 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-cd891aaa-8c3d-47a9-897d-0a82703b94d7 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:24:29.240200 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-cd891aaa-8c3d-47a9-897d-0a82703b94d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:29.335163 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 45/80] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:24:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:24:29.335163 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd891aaa-8c3d-47a9-897d-0a82703b94d7 None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:29.345500 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:29.360933 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404115db-e10f-42b0-9c62-7fe17d1c9f76 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:29.402180 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e9af4c-70de-4f20-b2c6-c9d368bfe57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:29.403216 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e9af4c-70de-4f20-b2c6-c9d368bfe57b None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:29.403649 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e9af4c-70de-4f20-b2c6-c9d368bfe57b None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:29.404116 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e9af4c-70de-4f20-b2c6-c9d368bfe57b None admin] PATH_INFO: `/v3/projects/e99ebc2f1eb141dc8c8555d0aea0cd1f` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:29.406006 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e9af4c-70de-4f20-b2c6-c9d368bfe57b None admin] RBAC: Authorizing `identity:get_project(project_id=e99ebc2f1eb141dc8c8555d0aea0cd1f)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:29.408593 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e9af4c-70de-4f20-b2c6-c9d368bfe57b None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:29.411309 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 36/81] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 15:24:29 2022] GET /identity/v3/projects/e99ebc2f1eb141dc8c8555d0aea0cd1f => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:24:29.413088 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e9af4c-70de-4f20-b2c6-c9d368bfe57b None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:29.457484 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd891aaa-8c3d-47a9-897d-0a82703b94d7 None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:29.496069 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:29.503713 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf5d61b-4382-49b5-b280-d3c123843808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:29.504686 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf5d61b-4382-49b5-b280-d3c123843808 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:29.505070 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf5d61b-4382-49b5-b280-d3c123843808 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:29.505359 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf5d61b-4382-49b5-b280-d3c123843808 None admin] PATH_INFO: `/v3/users/d861ca5a090d4492861528dc158b6822` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:29.506740 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf5d61b-4382-49b5-b280-d3c123843808 None admin] RBAC: Authorizing `identity:get_user(user_id=d861ca5a090d4492861528dc158b6822)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:29.508756 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf5d61b-4382-49b5-b280-d3c123843808 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:29.510902 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 46/82] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 26 15:24:29 2022] GET /identity/v3/users/d861ca5a090d4492861528dc158b6822 => generated 275 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:24:29.512253 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf5d61b-4382-49b5-b280-d3c123843808 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:29.545749 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e9af4c-70de-4f20-b2c6-c9d368bfe57b None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:29.583813 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9563d4-d0e2-46bc-ac29-4dc404feb278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:29.584450 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9563d4-d0e2-46bc-ac29-4dc404feb278 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:29.584733 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9563d4-d0e2-46bc-ac29-4dc404feb278 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:29.585012 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9563d4-d0e2-46bc-ac29-4dc404feb278 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:29.614830 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:29.648701 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf5d61b-4382-49b5-b280-d3c123843808 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:29.663070 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9563d4-d0e2-46bc-ac29-4dc404feb278 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:29.664626 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9563d4-d0e2-46bc-ac29-4dc404feb278 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:29.686937 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ae7098-6004-47de-9c13-c57dafb81289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:29.687679 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae7098-6004-47de-9c13-c57dafb81289 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:29.688033 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae7098-6004-47de-9c13-c57dafb81289 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:29.688325 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae7098-6004-47de-9c13-c57dafb81289 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:29.689641 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ae7098-6004-47de-9c13-c57dafb81289 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:29.691161 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ae7098-6004-47de-9c13-c57dafb81289 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:29.692842 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 47/83] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 15:24:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:24:29.693710 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ae7098-6004-47de-9c13-c57dafb81289 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:29.779210 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:29.780639 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 37/84] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 15:24:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 15:24:29.781597 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9563d4-d0e2-46bc-ac29-4dc404feb278 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:29.826456 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ae7098-6004-47de-9c13-c57dafb81289 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:29.843183 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:29.864526 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da4facb-7925-4359-a15c-b03be13b326a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:29.865251 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da4facb-7925-4359-a15c-b03be13b326a None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:29.865485 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da4facb-7925-4359-a15c-b03be13b326a None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:29.865831 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da4facb-7925-4359-a15c-b03be13b326a None admin] PATH_INFO: `/v3/roles/member` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:29.878693 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da4facb-7925-4359-a15c-b03be13b326a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:24:29.883795 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-8da4facb-7925-4359-a15c-b03be13b326a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 15:24:29.883795 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:24:29.883795 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:24:29.883795 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:24:29.883795 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:24:29.883795 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:24:29.883795 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:24:29.883795 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:24:29.883795 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:24:29.883795 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:24:29.883795 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:24:29.883795 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:24:29.883795 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:24:29.883795 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:24:29.883795 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:24:29.883795 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:24:29.884664 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:24:29.884664 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:24:29.884664 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:24:29.884664 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:24:29.884664 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:24:29.884664 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:24:29.884664 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:24:29.884664 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:24:29.884664 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:24:29.884664 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:24:29.884664 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:24:29.884664 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:24:29.884664 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:24:29.884664 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:24:29.884664 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:24:29.884664 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:24:29.885523 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:24:29.885523 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:24:29.885523 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:24:29.885523 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:24:29.885523 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:24:29.885523 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:24:29.885523 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:24:29.885523 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:24:29.885523 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:24:29.885523 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:24:29.885523 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 15:24:29.885523 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:24:29.885523 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 48/85] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 15:24:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:24:29.886155 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da4facb-7925-4359-a15c-b03be13b326a None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:29.890368 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9563d4-d0e2-46bc-ac29-4dc404feb278 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:29.926913 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8376202a-b8b0-4d8e-a1cc-4439eddd0343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:29.927857 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376202a-b8b0-4d8e-a1cc-4439eddd0343 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:29.928147 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376202a-b8b0-4d8e-a1cc-4439eddd0343 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:29.928443 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376202a-b8b0-4d8e-a1cc-4439eddd0343 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:29.929263 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8376202a-b8b0-4d8e-a1cc-4439eddd0343 None admin] RBAC: Adding query filter params (role.id=fd8f80bccab248edbb1d09ec187a8113, scope.project.id=e99ebc2f1eb141dc8c8555d0aea0cd1f, user.id=d861ca5a090d4492861528dc158b6822) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:24:29.929581 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8376202a-b8b0-4d8e-a1cc-4439eddd0343 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:29.931088 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8376202a-b8b0-4d8e-a1cc-4439eddd0343 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:29.938121 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 38/86] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 26 15:24:29 2022] GET /identity/v3/role_assignments?user.id=d861ca5a090d4492861528dc158b6822&scope.project.id=e99ebc2f1eb141dc8c8555d0aea0cd1f&role.id=fd8f80bccab248edbb1d09ec187a8113 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:24:29.938973 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8376202a-b8b0-4d8e-a1cc-4439eddd0343 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:30.024385 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da4facb-7925-4359-a15c-b03be13b326a None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:30.063991 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:30.073924 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3f15a0-435c-4556-915b-a8df3bd0334c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:30.074592 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f15a0-435c-4556-915b-a8df3bd0334c None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:30.074882 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f15a0-435c-4556-915b-a8df3bd0334c None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:30.075194 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f15a0-435c-4556-915b-a8df3bd0334c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:30.108014 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8376202a-b8b0-4d8e-a1cc-4439eddd0343 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:30.136601 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:30.156881 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d0185d-c5d7-4128-b0f9-fa0e19ed1e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:30.157429 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d0185d-c5d7-4128-b0f9-fa0e19ed1e3a None admin] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:30.157718 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d0185d-c5d7-4128-b0f9-fa0e19ed1e3a None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:30.158001 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d0185d-c5d7-4128-b0f9-fa0e19ed1e3a None admin] PATH_INFO: `/v3/users` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:30.159315 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d0185d-c5d7-4128-b0f9-fa0e19ed1e3a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:30.160266 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d0185d-c5d7-4128-b0f9-fa0e19ed1e3a None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:30.184914 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3f15a0-435c-4556-915b-a8df3bd0334c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:30.188488 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3f15a0-435c-4556-915b-a8df3bd0334c None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:30.269818 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 39/87] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Jul 26 15:24:29 2022] POST /identity/v3/users => generated 289 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:24:30.271586 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d0185d-c5d7-4128-b0f9-fa0e19ed1e3a None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:30.340218 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 49/88] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 15:24:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 15:24:30.341137 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3f15a0-435c-4556-915b-a8df3bd0334c None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:30.386745 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:30.430490 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d0185d-c5d7-4128-b0f9-fa0e19ed1e3a None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:30.473353 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb71bbce-093f-4b0c-818f-9923931f1e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:30.474429 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb71bbce-093f-4b0c-818f-9923931f1e41 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:30.474716 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb71bbce-093f-4b0c-818f-9923931f1e41 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:30.474996 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb71bbce-093f-4b0c-818f-9923931f1e41 None admin] PATH_INFO: `/v3/projects/e99ebc2f1eb141dc8c8555d0aea0cd1f` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:30.477041 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb71bbce-093f-4b0c-818f-9923931f1e41 None admin] RBAC: Authorizing `identity:get_project(project_id=e99ebc2f1eb141dc8c8555d0aea0cd1f)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:30.478539 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb71bbce-093f-4b0c-818f-9923931f1e41 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:30.486565 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 40/89] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 15:24:30 2022] GET /identity/v3/projects/e99ebc2f1eb141dc8c8555d0aea0cd1f => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:24:30.486565 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb71bbce-093f-4b0c-818f-9923931f1e41 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:30.528421 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3f15a0-435c-4556-915b-a8df3bd0334c None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:30.573494 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:30.590746 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f16d90-85d7-4350-bb58-9d697e47c3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:30.591718 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f16d90-85d7-4350-bb58-9d697e47c3ee None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:30.592312 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f16d90-85d7-4350-bb58-9d697e47c3ee None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:30.592887 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f16d90-85d7-4350-bb58-9d697e47c3ee None admin] PATH_INFO: `/v3/roles` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:30.594394 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f16d90-85d7-4350-bb58-9d697e47c3ee None admin] RBAC: Adding query filter params (name=member) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:24:30.594880 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f16d90-85d7-4350-bb58-9d697e47c3ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:30.597796 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f16d90-85d7-4350-bb58-9d697e47c3ee None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:30.608425 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 50/90] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jul 26 15:24:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:24:30.609762 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f16d90-85d7-4350-bb58-9d697e47c3ee None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:30.705224 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb71bbce-093f-4b0c-818f-9923931f1e41 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:30.770267 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d5273a-50a7-447b-8265-7c9c0f4f59a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:30.771428 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d5273a-50a7-447b-8265-7c9c0f4f59a5 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:30.771834 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:30.771938 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d5273a-50a7-447b-8265-7c9c0f4f59a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:30.772389 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d5273a-50a7-447b-8265-7c9c0f4f59a5 None admin] PATH_INFO: `/v3/projects/e99ebc2f1eb141dc8c8555d0aea0cd1f` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:30.775056 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d5273a-50a7-447b-8265-7c9c0f4f59a5 None admin] RBAC: Authorizing `identity:get_project(project_id=e99ebc2f1eb141dc8c8555d0aea0cd1f)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:30.777878 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d5273a-50a7-447b-8265-7c9c0f4f59a5 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:30.781416 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 41/91] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 15:24:30 2022] GET /identity/v3/projects/e99ebc2f1eb141dc8c8555d0aea0cd1f => generated 298 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:24:30.782688 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d5273a-50a7-447b-8265-7c9c0f4f59a5 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:30.784587 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f16d90-85d7-4350-bb58-9d697e47c3ee None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:30.828104 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2bf51b-ea06-477a-90db-ed14f7861274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:30.829184 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2bf51b-ea06-477a-90db-ed14f7861274 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:30.829667 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2bf51b-ea06-477a-90db-ed14f7861274 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:30.830098 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2bf51b-ea06-477a-90db-ed14f7861274 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:30.832056 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2bf51b-ea06-477a-90db-ed14f7861274 None admin] RBAC: Adding query filter params (role.id=2c659645e15c4204b1457556939397cb, scope.project.id=e99ebc2f1eb141dc8c8555d0aea0cd1f, user.id=18673fd27512449ab07302f33ac3c310) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:24:30.832728 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2bf51b-ea06-477a-90db-ed14f7861274 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:30.834612 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2bf51b-ea06-477a-90db-ed14f7861274 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:30.845761 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 51/92] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 26 15:24:30 2022] GET /identity/v3/role_assignments?user.id=18673fd27512449ab07302f33ac3c310&scope.project.id=e99ebc2f1eb141dc8c8555d0aea0cd1f&role.id=2c659645e15c4204b1457556939397cb => generated 259 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:24:30.847027 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2bf51b-ea06-477a-90db-ed14f7861274 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:30.982853 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d5273a-50a7-447b-8265-7c9c0f4f59a5 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:31.009607 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:31.054090 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dc4e09-f20c-4e97-8516-a1747e69c2df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:31.055333 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dc4e09-f20c-4e97-8516-a1747e69c2df None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:31.055865 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dc4e09-f20c-4e97-8516-a1747e69c2df None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:31.056382 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dc4e09-f20c-4e97-8516-a1747e69c2df None admin] PATH_INFO: `/v3/users/d861ca5a090d4492861528dc158b6822` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:31.058783 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dc4e09-f20c-4e97-8516-a1747e69c2df None admin] RBAC: Authorizing `identity:get_user(user_id=d861ca5a090d4492861528dc158b6822)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:31.062021 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dc4e09-f20c-4e97-8516-a1747e69c2df None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:31.066075 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 42/93] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 26 15:24:30 2022] GET /identity/v3/users/d861ca5a090d4492861528dc158b6822 => generated 275 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:24:31.075544 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dc4e09-f20c-4e97-8516-a1747e69c2df None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:31.110464 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2bf51b-ea06-477a-90db-ed14f7861274 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:31.197491 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffea335-2406-4e50-bbe0-099aeb48d0e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:31.198237 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffea335-2406-4e50-bbe0-099aeb48d0e3 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:31.198531 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffea335-2406-4e50-bbe0-099aeb48d0e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:31.198816 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffea335-2406-4e50-bbe0-099aeb48d0e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:31.199677 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffea335-2406-4e50-bbe0-099aeb48d0e3 None admin] RBAC: Adding query filter params (role.id=c86cdde38565431ebacf53dcfc4d863b, scope.project.id=e99ebc2f1eb141dc8c8555d0aea0cd1f, user.id=d861ca5a090d4492861528dc158b6822) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:24:31.200097 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffea335-2406-4e50-bbe0-099aeb48d0e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:31.201893 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffea335-2406-4e50-bbe0-099aeb48d0e3 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:31.217331 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 52/94] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 26 15:24:30 2022] GET /identity/v3/role_assignments?user.id=d861ca5a090d4492861528dc158b6822&scope.project.id=e99ebc2f1eb141dc8c8555d0aea0cd1f&role.id=c86cdde38565431ebacf53dcfc4d863b => generated 259 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:24:31.253414 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dc4e09-f20c-4e97-8516-a1747e69c2df None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:31.292541 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc81114-8212-4bc6-a28c-6cedb4eb162e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:31.293201 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc81114-8212-4bc6-a28c-6cedb4eb162e None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:31.293498 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc81114-8212-4bc6-a28c-6cedb4eb162e None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:31.293782 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc81114-8212-4bc6-a28c-6cedb4eb162e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:31.388440 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:31.428496 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc81114-8212-4bc6-a28c-6cedb4eb162e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:31.431537 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc81114-8212-4bc6-a28c-6cedb4eb162e None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:31.619246 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 43/95] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 15:24:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 15:24:31.624960 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffea335-2406-4e50-bbe0-099aeb48d0e3 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:31.658275 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:31.826385 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffea335-2406-4e50-bbe0-099aeb48d0e3 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:31.907105 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1525cb41-edf5-4065-99d7-07a316167171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:31.908226 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1525cb41-edf5-4065-99d7-07a316167171 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:31.908731 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1525cb41-edf5-4065-99d7-07a316167171 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:31.909346 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1525cb41-edf5-4065-99d7-07a316167171 None admin] PATH_INFO: `/v3/projects/5706c7a1aec5405294f04a88c93deec0` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:31.911774 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1525cb41-edf5-4065-99d7-07a316167171 None admin] RBAC: Authorizing `identity:get_project(project_id=5706c7a1aec5405294f04a88c93deec0)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:31.914583 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1525cb41-edf5-4065-99d7-07a316167171 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:31.917800 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 53/96] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 15:24:31 2022] GET /identity/v3/projects/5706c7a1aec5405294f04a88c93deec0 => generated 312 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:24:31.927977 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc81114-8212-4bc6-a28c-6cedb4eb162e None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:32.050725 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:32.073234 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc81114-8212-4bc6-a28c-6cedb4eb162e None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:32.112546 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1507091d-b061-4f35-a1ef-cc0c74fac68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:32.113187 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1507091d-b061-4f35-a1ef-cc0c74fac68d None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:32.113472 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1507091d-b061-4f35-a1ef-cc0c74fac68d None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:32.113748 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1507091d-b061-4f35-a1ef-cc0c74fac68d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:32.114558 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1507091d-b061-4f35-a1ef-cc0c74fac68d None admin] RBAC: Adding query filter params (role.id=fd8f80bccab248edbb1d09ec187a8113, scope.project.id=5706c7a1aec5405294f04a88c93deec0, user.id=d861ca5a090d4492861528dc158b6822) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:24:32.114875 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1507091d-b061-4f35-a1ef-cc0c74fac68d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:32.116384 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1507091d-b061-4f35-a1ef-cc0c74fac68d None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:32.122842 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 44/97] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 26 15:24:31 2022] GET /identity/v3/role_assignments?user.id=d861ca5a090d4492861528dc158b6822&scope.project.id=5706c7a1aec5405294f04a88c93deec0&role.id=fd8f80bccab248edbb1d09ec187a8113 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:24:32.952141 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea33f9-129c-41fc-b831-1c6badf1eaa9 None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:32.953696 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea33f9-129c-41fc-b831-1c6badf1eaa9 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:32.954271 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea33f9-129c-41fc-b831-1c6badf1eaa9 None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:32.955947 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 54/98] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:24:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:24:32.962033 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a7002-bce1-447c-aa26-86055c2ecafb None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:32.962989 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a7002-bce1-447c-aa26-86055c2ecafb None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:32.963530 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a7002-bce1-447c-aa26-86055c2ecafb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:32.990959 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-a24a7002-bce1-447c-aa26-86055c2ecafb None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:24:32.992906 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-a24a7002-bce1-447c-aa26-86055c2ecafb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:33.085277 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 45/99] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:24:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:24:33.127169 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ea33f9-129c-41fc-b831-1c6badf1eaa9 None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:33.243630 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:33.254686 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ea33f9-129c-41fc-b831-1c6badf1eaa9 None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:33.296430 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60341ae-d4f4-473a-8b0b-8e623953390e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:33.297143 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60341ae-d4f4-473a-8b0b-8e623953390e None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:33.297437 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60341ae-d4f4-473a-8b0b-8e623953390e None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:33.297718 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60341ae-d4f4-473a-8b0b-8e623953390e None admin] PATH_INFO: `/v3/roles/member` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:33.310103 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60341ae-d4f4-473a-8b0b-8e623953390e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:24:33.316143 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-f60341ae-d4f4-473a-8b0b-8e623953390e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 15:24:33.316143 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:24:33.316143 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:24:33.316143 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:24:33.316143 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:24:33.316143 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:24:33.316143 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:24:33.316143 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:24:33.316143 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:24:33.316143 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:24:33.316143 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:24:33.316143 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:24:33.316143 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:24:33.316143 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:24:33.316143 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:24:33.316143 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:24:33.317106 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:24:33.317106 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:24:33.317106 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:24:33.317106 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:24:33.317106 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:24:33.317106 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:24:33.317106 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:24:33.317106 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:24:33.317106 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:24:33.317106 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:24:33.317106 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:24:33.317106 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:24:33.317106 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:24:33.317106 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:24:33.317106 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:24:33.317106 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:24:33.317849 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:24:33.317849 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:24:33.317849 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:24:33.317849 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:24:33.317849 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:24:33.317849 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:24:33.317849 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:24:33.317849 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:24:33.317849 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:24:33.317849 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:24:33.317849 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 15:24:33.317849 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:24:33.317849 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 55/100] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 15:24:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:24:33.324832 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24a7002-bce1-447c-aa26-86055c2ecafb None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:33.427504 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:33.461083 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24a7002-bce1-447c-aa26-86055c2ecafb None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:33.513574 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f6a2f4-e2ca-4c02-8a5b-fc41c21d2edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:33.514213 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f6a2f4-e2ca-4c02-8a5b-fc41c21d2edf None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:33.514510 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f6a2f4-e2ca-4c02-8a5b-fc41c21d2edf None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:33.514793 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f6a2f4-e2ca-4c02-8a5b-fc41c21d2edf None admin] PATH_INFO: `/v3/roles` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:33.516117 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f6a2f4-e2ca-4c02-8a5b-fc41c21d2edf None admin] RBAC: Adding query filter params (name=member) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:24:33.516500 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f6a2f4-e2ca-4c02-8a5b-fc41c21d2edf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:33.517996 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f6a2f4-e2ca-4c02-8a5b-fc41c21d2edf None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:33.532616 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 46/101] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jul 26 15:24:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:24:33.538251 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60341ae-d4f4-473a-8b0b-8e623953390e None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:33.689649 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60341ae-d4f4-473a-8b0b-8e623953390e None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:33.741324 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d5a14a-ca78-4738-8d47-6f82d43c50bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:33.742007 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d5a14a-ca78-4738-8d47-6f82d43c50bc None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:33.742296 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d5a14a-ca78-4738-8d47-6f82d43c50bc None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:33.742581 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d5a14a-ca78-4738-8d47-6f82d43c50bc None admin] PATH_INFO: `/v3/users/d861ca5a090d4492861528dc158b6822` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:33.743858 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d5a14a-ca78-4738-8d47-6f82d43c50bc None admin] RBAC: Authorizing `identity:get_user(user_id=d861ca5a090d4492861528dc158b6822)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:33.745401 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d5a14a-ca78-4738-8d47-6f82d43c50bc None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:33.747327 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 56/102] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 26 15:24:33 2022] GET /identity/v3/users/d861ca5a090d4492861528dc158b6822 => generated 275 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:24:33.753591 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f6a2f4-e2ca-4c02-8a5b-fc41c21d2edf None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:33.967741 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f6a2f4-e2ca-4c02-8a5b-fc41c21d2edf None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:34.018223 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce4b0ed-8759-446c-aef9-4ffb2a4b2a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:34.018979 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce4b0ed-8759-446c-aef9-4ffb2a4b2a9a None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:34.019304 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce4b0ed-8759-446c-aef9-4ffb2a4b2a9a None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:34.019684 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce4b0ed-8759-446c-aef9-4ffb2a4b2a9a None admin] PATH_INFO: `/v3/projects/e99ebc2f1eb141dc8c8555d0aea0cd1f` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:34.020983 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce4b0ed-8759-446c-aef9-4ffb2a4b2a9a None admin] RBAC: Authorizing `identity:get_project(project_id=e99ebc2f1eb141dc8c8555d0aea0cd1f)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:34.022531 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce4b0ed-8759-446c-aef9-4ffb2a4b2a9a None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:34.024368 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 47/103] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 15:24:33 2022] GET /identity/v3/projects/e99ebc2f1eb141dc8c8555d0aea0cd1f => generated 298 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:24:34.030494 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d5a14a-ca78-4738-8d47-6f82d43c50bc None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:34.061062 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:34.095433 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc7eee-b8cb-4efb-840e-cb4de88c9ba0 None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:34.095741 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc7eee-b8cb-4efb-840e-cb4de88c9ba0 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:34.096010 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc7eee-b8cb-4efb-840e-cb4de88c9ba0 None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:34.097595 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 48/104] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:24:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:24:34.106169 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aab6a4-408d-4aad-97cf-951e8d930912 None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:34.106479 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aab6a4-408d-4aad-97cf-951e8d930912 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:34.106828 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aab6a4-408d-4aad-97cf-951e8d930912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:34.120546 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:34.145747 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-28aab6a4-408d-4aad-97cf-951e8d930912 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:24:34.147172 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-28aab6a4-408d-4aad-97cf-951e8d930912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:34.209150 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d5a14a-ca78-4738-8d47-6f82d43c50bc None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:34.284953 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e12823a-a149-431f-8f07-1e36efda7003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:34.284953 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e12823a-a149-431f-8f07-1e36efda7003 None admin] REQUEST_METHOD: `PUT` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:34.284953 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e12823a-a149-431f-8f07-1e36efda7003 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:34.284953 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e12823a-a149-431f-8f07-1e36efda7003 None admin] PATH_INFO: `/v3/projects/e99ebc2f1eb141dc8c8555d0aea0cd1f/users/d861ca5a090d4492861528dc158b6822/roles/fd8f80bccab248edbb1d09ec187a8113` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:34.290605 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 49/105] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:24:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 15:24:34.296181 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e12823a-a149-431f-8f07-1e36efda7003 None admin] RBAC: Authorizing `identity:create_grant(project_id=e99ebc2f1eb141dc8c8555d0aea0cd1f, user_id=d861ca5a090d4492861528dc158b6822, role_id=fd8f80bccab248edbb1d09ec187a8113)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:34.297848 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e12823a-a149-431f-8f07-1e36efda7003 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:34.299580 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6613ff26-8ddf-48d2-8ef0-b5ab346a316b None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:34.299883 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6613ff26-8ddf-48d2-8ef0-b5ab346a316b None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:34.300166 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6613ff26-8ddf-48d2-8ef0-b5ab346a316b None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:34.301623 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 50/106] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:24:34 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:24:34.310250 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102e46e6-feef-488a-9848-b61f5f38174c None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:34.310646 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102e46e6-feef-488a-9848-b61f5f38174c None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:34.310879 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102e46e6-feef-488a-9848-b61f5f38174c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:34.341895 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-102e46e6-feef-488a-9848-b61f5f38174c None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:24:34.343274 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-102e46e6-feef-488a-9848-b61f5f38174c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:34.399104 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 57/107] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jul 26 15:24:34 2022] PUT /identity/v3/projects/e99ebc2f1eb141dc8c8555d0aea0cd1f/users/d861ca5a090d4492861528dc158b6822/roles/fd8f80bccab248edbb1d09ec187a8113 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:24:34.400192 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e12823a-a149-431f-8f07-1e36efda7003 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:34.509178 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 51/108] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:24:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 15:24:34.540025 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:34.573485 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e12823a-a149-431f-8f07-1e36efda7003 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:34.591890 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102e46e6-feef-488a-9848-b61f5f38174c None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:34.618182 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f39cb87-d5d2-47f9-afe4-b3685bd6e4f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:34.619346 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f39cb87-d5d2-47f9-afe4-b3685bd6e4f7 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:34.619786 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f39cb87-d5d2-47f9-afe4-b3685bd6e4f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:34.620236 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f39cb87-d5d2-47f9-afe4-b3685bd6e4f7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:34.622470 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f39cb87-d5d2-47f9-afe4-b3685bd6e4f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:34.625405 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f39cb87-d5d2-47f9-afe4-b3685bd6e4f7 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:34.632057 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 58/109] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 15:24:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:24:34.635062 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f39cb87-d5d2-47f9-afe4-b3685bd6e4f7 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:34.755557 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:34.767061 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f39cb87-d5d2-47f9-afe4-b3685bd6e4f7 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:34.816278 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf42a4b-7723-4766-9857-ec7e32ebd84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:34.816517 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102e46e6-feef-488a-9848-b61f5f38174c None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:34.817310 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf42a4b-7723-4766-9857-ec7e32ebd84b None admin] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:34.817743 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf42a4b-7723-4766-9857-ec7e32ebd84b None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:34.818169 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf42a4b-7723-4766-9857-ec7e32ebd84b None admin] PATH_INFO: `/v3/projects` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:34.819026 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf42a4b-7723-4766-9857-ec7e32ebd84b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:34.820793 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf42a4b-7723-4766-9857-ec7e32ebd84b None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:34.840040 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:34.866378 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d80b5d-0d0c-426f-9d76-46d66a92e6b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:34.867097 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d80b5d-0d0c-426f-9d76-46d66a92e6b2 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:34.867499 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d80b5d-0d0c-426f-9d76-46d66a92e6b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:34.867798 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d80b5d-0d0c-426f-9d76-46d66a92e6b2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:34.882570 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d80b5d-0d0c-426f-9d76-46d66a92e6b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:24:34.888040 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application [None req-f2d80b5d-0d0c-426f-9d76-46d66a92e6b2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 15:24:34.888040 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:24:34.888040 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:24:34.888040 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:24:34.888040 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:24:34.888040 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:24:34.888040 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:24:34.888040 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:24:34.888040 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:24:34.888040 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:24:34.888040 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:24:34.888040 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:24:34.888040 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:24:34.888040 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:24:34.888040 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:24:34.888040 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:24:34.897105 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:24:34.897105 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:24:34.897105 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:24:34.897105 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:24:34.897105 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:24:34.897105 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:24:34.897105 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:24:34.897105 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:24:34.897105 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:24:34.897105 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:24:34.897105 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:24:34.897105 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application with Lock( Jul 26 15:24:34.897105 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:24:34.897105 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:24:34.897105 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:24:34.897105 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:24:34.897847 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:24:34.897847 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:24:34.897847 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:24:34.897847 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:24:34.897847 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:24:34.897847 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:24:34.897847 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:24:34.897847 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:24:34.897847 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:24:34.897847 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:24:34.897847 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 15:24:34.897847 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:24:34.897847 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 52/110] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 15:24:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 15:24:34.897847 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d80b5d-0d0c-426f-9d76-46d66a92e6b2 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:34.934476 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 59/111] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Jul 26 15:24:34 2022] POST /identity/v3/projects => generated 302 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:24:34.986660 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad31d4-f05b-4861-aace-3ade445edb4f None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:34.987278 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad31d4-f05b-4861-aace-3ade445edb4f None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:34.987782 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad31d4-f05b-4861-aace-3ade445edb4f None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:34.989607 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 60/112] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:24:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:24:34.996291 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb7b6d4-98d5-4516-aa07-07f61fbdbb7b None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:34.996879 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb7b6d4-98d5-4516-aa07-07f61fbdbb7b None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:34.997360 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb7b6d4-98d5-4516-aa07-07f61fbdbb7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:35.042666 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-dbb7b6d4-98d5-4516-aa07-07f61fbdbb7b None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:24:35.045116 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-dbb7b6d4-98d5-4516-aa07-07f61fbdbb7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:35.055514 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d80b5d-0d0c-426f-9d76-46d66a92e6b2 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:35.085107 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:35.099059 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a009a09e-1a32-478a-95cc-b4a73e98a646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:35.100105 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a009a09e-1a32-478a-95cc-b4a73e98a646 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:35.100597 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a009a09e-1a32-478a-95cc-b4a73e98a646 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:35.101034 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a009a09e-1a32-478a-95cc-b4a73e98a646 None admin] PATH_INFO: `/v3/roles` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:35.102001 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a009a09e-1a32-478a-95cc-b4a73e98a646 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:24:35.102487 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a009a09e-1a32-478a-95cc-b4a73e98a646 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:35.104214 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a009a09e-1a32-478a-95cc-b4a73e98a646 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:35.115799 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 53/113] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jul 26 15:24:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:24:35.122576 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a009a09e-1a32-478a-95cc-b4a73e98a646 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:35.237403 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 61/114] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:24:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 15:24:35.255399 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a009a09e-1a32-478a-95cc-b4a73e98a646 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:35.275705 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb7b6d4-98d5-4516-aa07-07f61fbdbb7b None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:35.301204 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83a0d70-7af9-468f-9d90-366bcc53d511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:35.302178 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a0d70-7af9-468f-9d90-366bcc53d511 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:35.302642 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a0d70-7af9-468f-9d90-366bcc53d511 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:35.303166 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a0d70-7af9-468f-9d90-366bcc53d511 None admin] PATH_INFO: `/v3/users/8f10fa4cc3f848d3b7273b748e1545f9` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:35.326790 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83a0d70-7af9-468f-9d90-366bcc53d511 None admin] RBAC: Authorizing `identity:get_user(user_id=8f10fa4cc3f848d3b7273b748e1545f9)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:35.328663 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83a0d70-7af9-468f-9d90-366bcc53d511 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:35.332104 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 54/115] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 26 15:24:35 2022] GET /identity/v3/users/8f10fa4cc3f848d3b7273b748e1545f9 => generated 289 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:24:35.338091 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83a0d70-7af9-468f-9d90-366bcc53d511 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:35.415649 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:35.483120 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb7b6d4-98d5-4516-aa07-07f61fbdbb7b None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:35.489072 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83a0d70-7af9-468f-9d90-366bcc53d511 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:35.521807 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:35.525587 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25683d8c-e9da-45ef-9d2d-193f31f3a21f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:35.526700 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25683d8c-e9da-45ef-9d2d-193f31f3a21f None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:35.527284 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25683d8c-e9da-45ef-9d2d-193f31f3a21f None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:35.527689 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25683d8c-e9da-45ef-9d2d-193f31f3a21f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:35.537421 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1961e60b-5986-4b65-b37c-b831d6e320dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:35.538585 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1961e60b-5986-4b65-b37c-b831d6e320dd None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:35.539473 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1961e60b-5986-4b65-b37c-b831d6e320dd None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:35.539951 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1961e60b-5986-4b65-b37c-b831d6e320dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:35.542590 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25683d8c-e9da-45ef-9d2d-193f31f3a21f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:24:35.549508 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-25683d8c-e9da-45ef-9d2d-193f31f3a21f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 15:24:35.549508 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:24:35.549508 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:24:35.549508 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:24:35.549508 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:24:35.549508 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:24:35.549508 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:24:35.549508 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:24:35.549508 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:24:35.549508 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:24:35.549508 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:24:35.549508 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:24:35.549508 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:24:35.549508 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:24:35.549508 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:24:35.549508 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:24:35.550527 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:24:35.550527 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:24:35.550527 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:24:35.550527 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:24:35.550527 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:24:35.550527 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:24:35.550527 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:24:35.550527 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:24:35.550527 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:24:35.550527 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:24:35.550527 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:24:35.550527 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:24:35.550527 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:24:35.550527 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:24:35.550527 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:24:35.550527 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:24:35.551638 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:24:35.551638 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:24:35.551638 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:24:35.551638 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:24:35.551638 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:24:35.551638 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:24:35.551638 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:24:35.551638 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:24:35.551638 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:24:35.551638 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:24:35.551638 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 15:24:35.551638 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:24:35.551638 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 62/116] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jul 26 15:24:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:24:35.553138 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bbf69b-b078-4944-8d20-6f5f57360f72 None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:35.553436 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bbf69b-b078-4944-8d20-6f5f57360f72 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:35.553731 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bbf69b-b078-4944-8d20-6f5f57360f72 None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:35.556185 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 63/117] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:24:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:24:35.562761 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bbf69b-b078-4944-8d20-6f5f57360f72 None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:35.644333 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1961e60b-5986-4b65-b37c-b831d6e320dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:35.645591 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1961e60b-5986-4b65-b37c-b831d6e320dd None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:35.708445 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:35.711602 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bbf69b-b078-4944-8d20-6f5f57360f72 None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:35.759329 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a634118-ae71-4f87-868f-0e5e608d96ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:35.760949 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a634118-ae71-4f87-868f-0e5e608d96ba None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:35.761531 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a634118-ae71-4f87-868f-0e5e608d96ba None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:35.761992 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a634118-ae71-4f87-868f-0e5e608d96ba None admin] PATH_INFO: `/v3/roles` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:35.763183 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a634118-ae71-4f87-868f-0e5e608d96ba None admin] RBAC: Adding query filter params (name=admin) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:24:35.763667 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a634118-ae71-4f87-868f-0e5e608d96ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:35.766723 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a634118-ae71-4f87-868f-0e5e608d96ba None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:35.772835 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 55/118] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 15:24:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 15:24:35.774933 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afee237-6855-4a24-9421-d163926b50c7 None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:35.775346 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afee237-6855-4a24-9421-d163926b50c7 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:35.775741 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afee237-6855-4a24-9421-d163926b50c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:35.779448 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 64/119] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 15:24:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:24:35.780822 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a634118-ae71-4f87-868f-0e5e608d96ba None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:35.798057 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-4afee237-6855-4a24-9421-d163926b50c7 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:24:35.799503 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-4afee237-6855-4a24-9421-d163926b50c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:35.849133 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:35.882344 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 56/120] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:24:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:24:35.883651 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afee237-6855-4a24-9421-d163926b50c7 None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:35.936505 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a634118-ae71-4f87-868f-0e5e608d96ba None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:35.976208 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2ea08c-fb09-45c0-a55c-f3dec5dac8c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:35.976876 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2ea08c-fb09-45c0-a55c-f3dec5dac8c3 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:35.977174 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2ea08c-fb09-45c0-a55c-f3dec5dac8c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:35.977460 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2ea08c-fb09-45c0-a55c-f3dec5dac8c3 None admin] PATH_INFO: `/v3/projects/e99ebc2f1eb141dc8c8555d0aea0cd1f` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:35.978712 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2ea08c-fb09-45c0-a55c-f3dec5dac8c3 None admin] RBAC: Authorizing `identity:get_project(project_id=e99ebc2f1eb141dc8c8555d0aea0cd1f)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:35.979571 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:35.980455 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2ea08c-fb09-45c0-a55c-f3dec5dac8c3 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:35.987276 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 65/121] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 15:24:35 2022] GET /identity/v3/projects/e99ebc2f1eb141dc8c8555d0aea0cd1f => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:24:35.988308 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2ea08c-fb09-45c0-a55c-f3dec5dac8c3 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:36.030034 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afee237-6855-4a24-9421-d163926b50c7 None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:36.100000 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89d06b6-d942-4f7a-bdf3-cc215fc1d95e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:36.100993 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89d06b6-d942-4f7a-bdf3-cc215fc1d95e None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:36.101471 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89d06b6-d942-4f7a-bdf3-cc215fc1d95e None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:36.101959 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89d06b6-d942-4f7a-bdf3-cc215fc1d95e None admin] PATH_INFO: `/v3/users/18673fd27512449ab07302f33ac3c310` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:36.104402 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89d06b6-d942-4f7a-bdf3-cc215fc1d95e None admin] RBAC: Authorizing `identity:get_user(user_id=18673fd27512449ab07302f33ac3c310)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:36.106888 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89d06b6-d942-4f7a-bdf3-cc215fc1d95e None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:36.110606 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 57/122] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 26 15:24:35 2022] GET /identity/v3/users/18673fd27512449ab07302f33ac3c310 => generated 247 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:24:36.111874 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89d06b6-d942-4f7a-bdf3-cc215fc1d95e None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:36.116064 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2ea08c-fb09-45c0-a55c-f3dec5dac8c3 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:36.139561 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:36.164798 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2ec5bd-d826-4cfd-bed0-6c08bee268b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:36.165836 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ec5bd-d826-4cfd-bed0-6c08bee268b8 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:36.166922 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ec5bd-d826-4cfd-bed0-6c08bee268b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:36.167452 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ec5bd-d826-4cfd-bed0-6c08bee268b8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:36.184255 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2ec5bd-d826-4cfd-bed0-6c08bee268b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:24:36.191540 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-9f2ec5bd-d826-4cfd-bed0-6c08bee268b8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 15:24:36.191540 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:24:36.191540 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:24:36.191540 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:24:36.191540 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:24:36.191540 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:24:36.191540 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:24:36.191540 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:24:36.191540 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:24:36.191540 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:24:36.191540 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:24:36.191540 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:24:36.191540 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:24:36.191540 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:24:36.191540 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:24:36.191540 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:24:36.192461 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:24:36.192461 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:24:36.192461 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:24:36.192461 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:24:36.192461 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:24:36.192461 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:24:36.192461 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:24:36.192461 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:24:36.192461 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:24:36.192461 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:24:36.192461 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:24:36.192461 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:24:36.192461 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:24:36.192461 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:24:36.192461 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:24:36.192461 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:24:36.193247 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:24:36.193247 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:24:36.193247 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:24:36.193247 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:24:36.193247 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:24:36.193247 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:24:36.193247 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:24:36.193247 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:24:36.193247 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:24:36.193247 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:24:36.193247 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 15:24:36.193247 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:24:36.196490 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 66/123] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jul 26 15:24:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:24:36.198707 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b853b05c-9bbc-4715-ae09-9b2ee0207ca1 None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:36.199575 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b853b05c-9bbc-4715-ae09-9b2ee0207ca1 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:36.200089 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b853b05c-9bbc-4715-ae09-9b2ee0207ca1 None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:36.201941 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 67/124] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:24:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:24:36.203640 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b853b05c-9bbc-4715-ae09-9b2ee0207ca1 None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:36.318591 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89d06b6-d942-4f7a-bdf3-cc215fc1d95e None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:36.354894 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b853b05c-9bbc-4715-ae09-9b2ee0207ca1 None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:36.376560 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f0cb6c-998c-4a79-97ee-2f5a45bcd660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:36.377560 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f0cb6c-998c-4a79-97ee-2f5a45bcd660 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:36.378048 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f0cb6c-998c-4a79-97ee-2f5a45bcd660 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:36.378527 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f0cb6c-998c-4a79-97ee-2f5a45bcd660 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:36.380294 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f0cb6c-998c-4a79-97ee-2f5a45bcd660 None admin] RBAC: Adding query filter params (role.id=c692edefa26c417c8d43da5d89ec8462, scope.project.id=e99ebc2f1eb141dc8c8555d0aea0cd1f, user.id=8f10fa4cc3f848d3b7273b748e1545f9) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:24:36.381119 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f0cb6c-998c-4a79-97ee-2f5a45bcd660 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:36.383561 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f0cb6c-998c-4a79-97ee-2f5a45bcd660 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:36.392925 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 58/125] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 26 15:24:36 2022] GET /identity/v3/role_assignments?user.id=8f10fa4cc3f848d3b7273b748e1545f9&scope.project.id=e99ebc2f1eb141dc8c8555d0aea0cd1f&role.id=c692edefa26c417c8d43da5d89ec8462 => generated 259 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:24:36.395422 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f0cb6c-998c-4a79-97ee-2f5a45bcd660 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:36.404211 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b096282-e4fd-4bd2-875c-75d95768ec75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:36.404967 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b096282-e4fd-4bd2-875c-75d95768ec75 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:36.405365 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b096282-e4fd-4bd2-875c-75d95768ec75 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:36.405736 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b096282-e4fd-4bd2-875c-75d95768ec75 None admin] PATH_INFO: `/v3/projects/e99ebc2f1eb141dc8c8555d0aea0cd1f` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:36.406837 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:36.407763 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b096282-e4fd-4bd2-875c-75d95768ec75 None admin] RBAC: Authorizing `identity:get_project(project_id=e99ebc2f1eb141dc8c8555d0aea0cd1f)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:36.409209 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b096282-e4fd-4bd2-875c-75d95768ec75 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:36.411490 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 68/126] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 15:24:36 2022] GET /identity/v3/projects/e99ebc2f1eb141dc8c8555d0aea0cd1f => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:24:36.413271 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08148bf-9c45-4d0f-a263-c7505f3d21e2 None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:36.419684 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08148bf-9c45-4d0f-a263-c7505f3d21e2 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:36.420658 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08148bf-9c45-4d0f-a263-c7505f3d21e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:36.462028 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-e08148bf-9c45-4d0f-a263-c7505f3d21e2 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:24:36.463501 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-e08148bf-9c45-4d0f-a263-c7505f3d21e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:36.570816 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:36.609639 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f0cb6c-998c-4a79-97ee-2f5a45bcd660 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:36.660134 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 69/127] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:24:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:24:36.661684 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08148bf-9c45-4d0f-a263-c7505f3d21e2 None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:36.679327 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac0c588-0327-4d17-b14f-ee8748afaa17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:36.679985 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac0c588-0327-4d17-b14f-ee8748afaa17 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:36.680274 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac0c588-0327-4d17-b14f-ee8748afaa17 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:36.680551 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac0c588-0327-4d17-b14f-ee8748afaa17 None admin] PATH_INFO: `/v3/roles` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:36.681294 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac0c588-0327-4d17-b14f-ee8748afaa17 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:24:36.681605 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac0c588-0327-4d17-b14f-ee8748afaa17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:36.683048 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac0c588-0327-4d17-b14f-ee8748afaa17 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:36.698840 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 59/128] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 15:24:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:24:36.704842 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac0c588-0327-4d17-b14f-ee8748afaa17 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:36.839007 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:36.851169 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08148bf-9c45-4d0f-a263-c7505f3d21e2 None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:36.899909 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3343ee-1abf-4553-b0b0-26cb5e67f8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:36.903164 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3343ee-1abf-4553-b0b0-26cb5e67f8ed None admin] REQUEST_METHOD: `PUT` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:36.903164 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3343ee-1abf-4553-b0b0-26cb5e67f8ed None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:36.903164 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3343ee-1abf-4553-b0b0-26cb5e67f8ed None admin] PATH_INFO: `/v3/projects/e99ebc2f1eb141dc8c8555d0aea0cd1f/users/18673fd27512449ab07302f33ac3c310/roles/2c659645e15c4204b1457556939397cb` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:36.904659 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3343ee-1abf-4553-b0b0-26cb5e67f8ed None admin] RBAC: Authorizing `identity:create_grant(project_id=e99ebc2f1eb141dc8c8555d0aea0cd1f, user_id=18673fd27512449ab07302f33ac3c310, role_id=2c659645e15c4204b1457556939397cb)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:36.906799 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3343ee-1abf-4553-b0b0-26cb5e67f8ed None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:36.933183 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac0c588-0327-4d17-b14f-ee8748afaa17 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:36.976902 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b850e732-701c-4962-9da6-bc6663a0928e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:36.977634 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850e732-701c-4962-9da6-bc6663a0928e None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:36.977929 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850e732-701c-4962-9da6-bc6663a0928e None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:36.978215 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850e732-701c-4962-9da6-bc6663a0928e None admin] PATH_INFO: `/v3/users/d861ca5a090d4492861528dc158b6822` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:36.979656 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b850e732-701c-4962-9da6-bc6663a0928e None admin] RBAC: Authorizing `identity:get_user(user_id=d861ca5a090d4492861528dc158b6822)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:36.987491 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b850e732-701c-4962-9da6-bc6663a0928e None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:36.993970 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 60/129] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 26 15:24:36 2022] GET /identity/v3/users/d861ca5a090d4492861528dc158b6822 => generated 275 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:24:36.993970 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b850e732-701c-4962-9da6-bc6663a0928e None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:37.026040 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 70/130] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jul 26 15:24:36 2022] PUT /identity/v3/projects/e99ebc2f1eb141dc8c8555d0aea0cd1f/users/18673fd27512449ab07302f33ac3c310/roles/2c659645e15c4204b1457556939397cb => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:24:37.026732 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3343ee-1abf-4553-b0b0-26cb5e67f8ed None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:37.102669 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:37.236771 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b850e732-701c-4962-9da6-bc6663a0928e None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:37.238354 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3343ee-1abf-4553-b0b0-26cb5e67f8ed None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:37.310401 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd0084a-e95b-4c08-859f-8fac9b610030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:37.311088 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd0084a-e95b-4c08-859f-8fac9b610030 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:37.311487 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd0084a-e95b-4c08-859f-8fac9b610030 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:37.311700 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd0084a-e95b-4c08-859f-8fac9b610030 None admin] PATH_INFO: `/v3/projects/e99ebc2f1eb141dc8c8555d0aea0cd1f` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:37.316249 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd0084a-e95b-4c08-859f-8fac9b610030 None admin] RBAC: Authorizing `identity:get_project(project_id=e99ebc2f1eb141dc8c8555d0aea0cd1f)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:37.317836 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd0084a-e95b-4c08-859f-8fac9b610030 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:37.319748 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 71/131] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 15:24:37 2022] GET /identity/v3/projects/e99ebc2f1eb141dc8c8555d0aea0cd1f => generated 298 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:24:37.327238 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd0084a-e95b-4c08-859f-8fac9b610030 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:37.348181 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f443ef65-24d4-45b3-a116-3085fd0272e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:37.348851 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f443ef65-24d4-45b3-a116-3085fd0272e3 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:37.349136 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f443ef65-24d4-45b3-a116-3085fd0272e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:37.349414 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f443ef65-24d4-45b3-a116-3085fd0272e3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:37.356737 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:37.376088 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f443ef65-24d4-45b3-a116-3085fd0272e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:24:37.390006 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application [None req-f443ef65-24d4-45b3-a116-3085fd0272e3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 15:24:37.390006 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:24:37.390006 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:24:37.390006 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:24:37.390006 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:24:37.390006 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:24:37.390006 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:24:37.390006 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:24:37.390006 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:24:37.390006 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:24:37.390006 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:24:37.390006 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:24:37.390006 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:24:37.390006 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:24:37.390006 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:24:37.390006 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:24:37.393448 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:24:37.393448 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:24:37.393448 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:24:37.393448 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:24:37.393448 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:24:37.393448 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:24:37.393448 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:24:37.393448 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:24:37.393448 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:24:37.393448 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:24:37.393448 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:24:37.393448 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application with Lock( Jul 26 15:24:37.393448 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:24:37.393448 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:24:37.393448 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:24:37.393448 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:24:37.396474 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:24:37.396474 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:24:37.396474 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:24:37.396474 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:24:37.396474 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:24:37.396474 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:24:37.396474 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:24:37.396474 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:24:37.396474 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:24:37.396474 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:24:37.396474 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 15:24:37.396474 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:24:37.405195 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 61/132] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 15:24:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 407 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:24:37.415164 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f443ef65-24d4-45b3-a116-3085fd0272e3 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:37.549967 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:37.552896 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd0084a-e95b-4c08-859f-8fac9b610030 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:37.603418 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80f3552-49eb-4759-b950-a8a05c8e1e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:37.604116 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80f3552-49eb-4759-b950-a8a05c8e1e26 None admin] REQUEST_METHOD: `PUT` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:37.604405 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80f3552-49eb-4759-b950-a8a05c8e1e26 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:37.604686 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80f3552-49eb-4759-b950-a8a05c8e1e26 None admin] PATH_INFO: `/v3/projects/e99ebc2f1eb141dc8c8555d0aea0cd1f/users/d861ca5a090d4492861528dc158b6822/roles/c86cdde38565431ebacf53dcfc4d863b` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:37.609740 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f443ef65-24d4-45b3-a116-3085fd0272e3 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:37.612693 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80f3552-49eb-4759-b950-a8a05c8e1e26 None admin] RBAC: Authorizing `identity:create_grant(project_id=e99ebc2f1eb141dc8c8555d0aea0cd1f, user_id=d861ca5a090d4492861528dc158b6822, role_id=c86cdde38565431ebacf53dcfc4d863b)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:37.614305 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80f3552-49eb-4759-b950-a8a05c8e1e26 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:37.672628 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ae7fcc-e227-491c-9cfb-b0ea7e8e57a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:37.673287 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae7fcc-e227-491c-9cfb-b0ea7e8e57a4 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:37.673582 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae7fcc-e227-491c-9cfb-b0ea7e8e57a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:37.673927 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae7fcc-e227-491c-9cfb-b0ea7e8e57a4 None admin] PATH_INFO: `/v3/roles` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:37.674689 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ae7fcc-e227-491c-9cfb-b0ea7e8e57a4 None admin] RBAC: Adding query filter params (name=member) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:24:37.675004 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ae7fcc-e227-491c-9cfb-b0ea7e8e57a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:37.676554 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ae7fcc-e227-491c-9cfb-b0ea7e8e57a4 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:37.698844 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 72/133] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jul 26 15:24:37 2022] PUT /identity/v3/projects/e99ebc2f1eb141dc8c8555d0aea0cd1f/users/d861ca5a090d4492861528dc158b6822/roles/c86cdde38565431ebacf53dcfc4d863b => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:24:37.700514 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 62/134] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jul 26 15:24:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:24:37.707181 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80f3552-49eb-4759-b950-a8a05c8e1e26 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:37.869948 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80f3552-49eb-4759-b950-a8a05c8e1e26 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:37.925265 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c24804d-3b6a-44d1-b17f-596d075d0f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:37.925952 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c24804d-3b6a-44d1-b17f-596d075d0f29 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:37.926242 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c24804d-3b6a-44d1-b17f-596d075d0f29 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:37.926526 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c24804d-3b6a-44d1-b17f-596d075d0f29 None admin] PATH_INFO: `/v3/users/d861ca5a090d4492861528dc158b6822` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:37.930906 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c24804d-3b6a-44d1-b17f-596d075d0f29 None admin] RBAC: Authorizing `identity:get_user(user_id=d861ca5a090d4492861528dc158b6822)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:37.932643 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c24804d-3b6a-44d1-b17f-596d075d0f29 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:37.935243 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 73/135] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 26 15:24:37 2022] GET /identity/v3/users/d861ca5a090d4492861528dc158b6822 => generated 275 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:24:37.942631 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ae7fcc-e227-491c-9cfb-b0ea7e8e57a4 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:38.057433 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:38.125564 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ae7fcc-e227-491c-9cfb-b0ea7e8e57a4 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:38.156758 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d096ec-7c34-4da7-98b0-01be0605eaa2 None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:38.157064 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d096ec-7c34-4da7-98b0-01be0605eaa2 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:38.157334 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d096ec-7c34-4da7-98b0-01be0605eaa2 None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:38.158898 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 74/136] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:24:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:24:38.169054 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a45c059-39da-46cb-9c21-662c67e454a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:38.169977 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45c059-39da-46cb-9c21-662c67e454a3 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:38.170264 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45c059-39da-46cb-9c21-662c67e454a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:38.170603 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45c059-39da-46cb-9c21-662c67e454a3 None admin] PATH_INFO: `/v3/projects/5706c7a1aec5405294f04a88c93deec0` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:38.171917 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a45c059-39da-46cb-9c21-662c67e454a3 None admin] RBAC: Authorizing `identity:get_project(project_id=5706c7a1aec5405294f04a88c93deec0)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:38.172807 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d74676-983f-4f62-87bf-ead1c9cc8181 None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:38.173101 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d74676-983f-4f62-87bf-ead1c9cc8181 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:38.173392 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d74676-983f-4f62-87bf-ead1c9cc8181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:38.173594 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a45c059-39da-46cb-9c21-662c67e454a3 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:38.175492 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 63/137] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 15:24:37 2022] GET /identity/v3/projects/5706c7a1aec5405294f04a88c93deec0 => generated 312 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:24:38.181648 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a45c059-39da-46cb-9c21-662c67e454a3 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:38.216251 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-c1d74676-983f-4f62-87bf-ead1c9cc8181 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:24:38.217511 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-c1d74676-983f-4f62-87bf-ead1c9cc8181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:38.281244 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:38.298430 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a45c059-39da-46cb-9c21-662c67e454a3 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:38.330070 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:38.339320 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580584a5-dc6b-4014-abd2-ebc2b687c3db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:38.340023 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580584a5-dc6b-4014-abd2-ebc2b687c3db None admin] REQUEST_METHOD: `PUT` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:38.340315 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580584a5-dc6b-4014-abd2-ebc2b687c3db None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:38.340599 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580584a5-dc6b-4014-abd2-ebc2b687c3db None admin] PATH_INFO: `/v3/projects/5706c7a1aec5405294f04a88c93deec0/users/d861ca5a090d4492861528dc158b6822/roles/fd8f80bccab248edbb1d09ec187a8113` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:38.342742 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580584a5-dc6b-4014-abd2-ebc2b687c3db None admin] RBAC: Authorizing `identity:create_grant(project_id=5706c7a1aec5405294f04a88c93deec0, user_id=d861ca5a090d4492861528dc158b6822, role_id=fd8f80bccab248edbb1d09ec187a8113)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:38.344738 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580584a5-dc6b-4014-abd2-ebc2b687c3db None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:38.381913 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 75/138] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:24:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:24:38.406785 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d74676-983f-4f62-87bf-ead1c9cc8181 None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:38.477348 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 64/139] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jul 26 15:24:38 2022] PUT /identity/v3/projects/5706c7a1aec5405294f04a88c93deec0/users/d861ca5a090d4492861528dc158b6822/roles/fd8f80bccab248edbb1d09ec187a8113 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:24:38.562191 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d74676-983f-4f62-87bf-ead1c9cc8181 None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:38.613903 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf0dff-8f26-4449-b8f4-9928041da2e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:38.614580 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf0dff-8f26-4449-b8f4-9928041da2e3 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:38.614867 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf0dff-8f26-4449-b8f4-9928041da2e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:38.615167 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf0dff-8f26-4449-b8f4-9928041da2e3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:38.632782 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abf0dff-8f26-4449-b8f4-9928041da2e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:24:38.637942 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-4abf0dff-8f26-4449-b8f4-9928041da2e3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 15:24:38.637942 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:24:38.637942 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:24:38.637942 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:24:38.637942 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:24:38.637942 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:24:38.637942 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:24:38.637942 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:24:38.637942 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:24:38.637942 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:24:38.637942 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:24:38.637942 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:24:38.637942 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:24:38.637942 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:24:38.637942 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:24:38.637942 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:24:38.638838 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:24:38.638838 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:24:38.638838 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:24:38.638838 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:24:38.638838 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:24:38.638838 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:24:38.638838 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:24:38.638838 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:24:38.638838 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:24:38.638838 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:24:38.638838 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:24:38.638838 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:24:38.638838 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:24:38.638838 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:24:38.638838 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:24:38.638838 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:24:38.639606 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:24:38.639606 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:24:38.639606 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:24:38.639606 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:24:38.639606 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:24:38.639606 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:24:38.639606 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:24:38.639606 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:24:38.639606 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:24:38.639606 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:24:38.639606 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 15:24:38.639606 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:24:38.639606 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 76/140] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 15:24:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 15:24:38.647966 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580584a5-dc6b-4014-abd2-ebc2b687c3db None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:38.838791 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580584a5-dc6b-4014-abd2-ebc2b687c3db None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:38.884073 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66778acd-3126-4435-9eb2-835ba7013e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:38.885084 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66778acd-3126-4435-9eb2-835ba7013e54 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:38.885203 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66778acd-3126-4435-9eb2-835ba7013e54 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:38.889003 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66778acd-3126-4435-9eb2-835ba7013e54 None admin] PATH_INFO: `/v3/roles` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:38.889003 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66778acd-3126-4435-9eb2-835ba7013e54 None admin] RBAC: Adding query filter params (name=member) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:24:38.889003 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66778acd-3126-4435-9eb2-835ba7013e54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:38.889003 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66778acd-3126-4435-9eb2-835ba7013e54 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:38.898231 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 65/141] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jul 26 15:24:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:24:38.904270 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf0dff-8f26-4449-b8f4-9928041da2e3 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:38.952653 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:39.004097 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e4e215-f095-4bb7-bfaa-b3373d04f269 None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:39.004408 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e4e215-f095-4bb7-bfaa-b3373d04f269 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:39.004679 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e4e215-f095-4bb7-bfaa-b3373d04f269 None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:39.006197 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 66/142] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:24:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:24:39.012178 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c86aeb3-46d4-40cc-af37-f82a349eb128 None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:39.012624 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c86aeb3-46d4-40cc-af37-f82a349eb128 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:39.013015 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c86aeb3-46d4-40cc-af37-f82a349eb128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:39.048485 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-1c86aeb3-46d4-40cc-af37-f82a349eb128 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:24:39.049887 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-1c86aeb3-46d4-40cc-af37-f82a349eb128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:39.126321 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf0dff-8f26-4449-b8f4-9928041da2e3 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:39.153752 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:39.208861 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 67/143] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:24:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 15:24:39.209288 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd8779d-0fb1-4c39-8901-5d1dc466cbb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:39.209962 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd8779d-0fb1-4c39-8901-5d1dc466cbb6 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:39.210250 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd8779d-0fb1-4c39-8901-5d1dc466cbb6 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:39.210528 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd8779d-0fb1-4c39-8901-5d1dc466cbb6 None admin] PATH_INFO: `/v3/users/d861ca5a090d4492861528dc158b6822` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:39.215075 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd8779d-0fb1-4c39-8901-5d1dc466cbb6 None admin] RBAC: Authorizing `identity:get_user(user_id=d861ca5a090d4492861528dc158b6822)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:39.216640 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd8779d-0fb1-4c39-8901-5d1dc466cbb6 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:39.218365 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 77/144] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 26 15:24:38 2022] GET /identity/v3/users/d861ca5a090d4492861528dc158b6822 => generated 275 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:24:39.224017 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c86aeb3-46d4-40cc-af37-f82a349eb128 None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:39.280339 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd8779d-0fb1-4c39-8901-5d1dc466cbb6 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:39.443667 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:39.449464 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c86aeb3-46d4-40cc-af37-f82a349eb128 None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:39.453953 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd8779d-0fb1-4c39-8901-5d1dc466cbb6 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:39.524697 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75ef378-8cf7-4802-b258-5615c0f9d497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:39.525442 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ef378-8cf7-4802-b258-5615c0f9d497 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:39.525737 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ef378-8cf7-4802-b258-5615c0f9d497 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:39.526023 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ef378-8cf7-4802-b258-5615c0f9d497 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:39.532109 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75ef378-8cf7-4802-b258-5615c0f9d497 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:39.533718 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75ef378-8cf7-4802-b258-5615c0f9d497 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:39.535527 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 78/145] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 15:24:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:24:39.540336 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4949c080-2e99-4252-b7a7-972796178860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:39.540997 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4949c080-2e99-4252-b7a7-972796178860 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:39.541297 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4949c080-2e99-4252-b7a7-972796178860 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:39.541584 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4949c080-2e99-4252-b7a7-972796178860 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:39.551088 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75ef378-8cf7-4802-b258-5615c0f9d497 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:39.636043 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:39.703337 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4949c080-2e99-4252-b7a7-972796178860 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:39.703337 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4949c080-2e99-4252-b7a7-972796178860 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:39.763637 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75ef378-8cf7-4802-b258-5615c0f9d497 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:39.849873 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 68/146] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 15:24:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 626 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 15:24:39.856514 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4949c080-2e99-4252-b7a7-972796178860 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:39.879916 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d4649c-971b-476b-ba15-5b26a9c1b4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:39.880572 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d4649c-971b-476b-ba15-5b26a9c1b4f9 None admin] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:39.880876 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d4649c-971b-476b-ba15-5b26a9c1b4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:39.881197 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d4649c-971b-476b-ba15-5b26a9c1b4f9 None admin] PATH_INFO: `/v3/users` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:39.881866 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d4649c-971b-476b-ba15-5b26a9c1b4f9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:39.883438 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d4649c-971b-476b-ba15-5b26a9c1b4f9 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:40.016122 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:40.043186 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 79/147] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Jul 26 15:24:39 2022] POST /identity/v3/users => generated 283 bytes in 493 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:24:40.044700 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4949c080-2e99-4252-b7a7-972796178860 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:40.044808 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d56423-a3db-4b67-85a8-f5f3d231d416 None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:40.045033 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d56423-a3db-4b67-85a8-f5f3d231d416 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:40.045316 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d56423-a3db-4b67-85a8-f5f3d231d416 None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:40.052471 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 80/148] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:24:40 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:24:40.063749 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e8741c-2b6f-4225-8a60-5d27a408de2d None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:40.064078 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e8741c-2b6f-4225-8a60-5d27a408de2d None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:40.064321 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e8741c-2b6f-4225-8a60-5d27a408de2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:40.102911 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-98e8741c-2b6f-4225-8a60-5d27a408de2d None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:24:40.104261 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-98e8741c-2b6f-4225-8a60-5d27a408de2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:40.109181 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:40.124993 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55937c9c-7049-470d-ba88-369d22052ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:40.125668 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55937c9c-7049-470d-ba88-369d22052ebc None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:40.125957 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55937c9c-7049-470d-ba88-369d22052ebc None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:40.126307 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55937c9c-7049-470d-ba88-369d22052ebc None admin] PATH_INFO: `/v3/projects/e99ebc2f1eb141dc8c8555d0aea0cd1f` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:40.127650 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55937c9c-7049-470d-ba88-369d22052ebc None admin] RBAC: Authorizing `identity:get_project(project_id=e99ebc2f1eb141dc8c8555d0aea0cd1f)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:40.129167 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55937c9c-7049-470d-ba88-369d22052ebc None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:40.130906 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 69/149] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 15:24:39 2022] GET /identity/v3/projects/e99ebc2f1eb141dc8c8555d0aea0cd1f => generated 298 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:24:40.140791 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55937c9c-7049-470d-ba88-369d22052ebc None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:40.251546 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 81/150] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:24:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:24:40.294779 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e8741c-2b6f-4225-8a60-5d27a408de2d None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:40.382652 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55937c9c-7049-470d-ba88-369d22052ebc None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:40.501639 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaa384b-9004-42f9-8bcb-704a3db9dec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:40.502715 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa384b-9004-42f9-8bcb-704a3db9dec0 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:40.503259 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa384b-9004-42f9-8bcb-704a3db9dec0 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:40.503765 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa384b-9004-42f9-8bcb-704a3db9dec0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:40.505307 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaa384b-9004-42f9-8bcb-704a3db9dec0 None admin] RBAC: Adding query filter params (role.id=fd8f80bccab248edbb1d09ec187a8113, scope.project.id=e99ebc2f1eb141dc8c8555d0aea0cd1f, user.id=d861ca5a090d4492861528dc158b6822) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:24:40.505880 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaa384b-9004-42f9-8bcb-704a3db9dec0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:40.508797 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaa384b-9004-42f9-8bcb-704a3db9dec0 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:40.539389 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 70/151] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 26 15:24:40 2022] GET /identity/v3/role_assignments?user.id=d861ca5a090d4492861528dc158b6822&scope.project.id=e99ebc2f1eb141dc8c8555d0aea0cd1f&role.id=fd8f80bccab248edbb1d09ec187a8113 => generated 608 bytes in 393 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:24:40.615757 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e8741c-2b6f-4225-8a60-5d27a408de2d None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:40.705866 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a53fa30-899f-452c-944c-d95fb9c20589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:40.707039 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a53fa30-899f-452c-944c-d95fb9c20589 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:40.707542 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a53fa30-899f-452c-944c-d95fb9c20589 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:40.708042 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a53fa30-899f-452c-944c-d95fb9c20589 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:40.715342 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6df4f1e-061f-4e3f-944e-cf26957a106e None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:40.715870 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6df4f1e-061f-4e3f-944e-cf26957a106e None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:40.716345 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6df4f1e-061f-4e3f-944e-cf26957a106e None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:40.719503 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 71/152] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:24:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:24:40.725791 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922c0cda-c650-40ee-8cb0-4e210c482875 None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:40.726281 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922c0cda-c650-40ee-8cb0-4e210c482875 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:40.726783 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922c0cda-c650-40ee-8cb0-4e210c482875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:40.751948 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:40.760424 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a53fa30-899f-452c-944c-d95fb9c20589 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:24:40.769092 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-1a53fa30-899f-452c-944c-d95fb9c20589 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 15:24:40.769092 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:24:40.769092 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:24:40.769092 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:24:40.769092 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:24:40.769092 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:24:40.769092 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:24:40.769092 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:24:40.769092 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:24:40.769092 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:24:40.769092 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:24:40.769092 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:24:40.769092 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:24:40.769092 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:24:40.769092 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:24:40.769092 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:24:40.770221 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:24:40.770221 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:24:40.770221 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:24:40.770221 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:24:40.770221 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:24:40.770221 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:24:40.770221 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:24:40.770221 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:24:40.770221 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:24:40.770221 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:24:40.770221 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:24:40.770221 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:24:40.770221 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:24:40.770221 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:24:40.770221 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:24:40.770221 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:24:40.771611 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:24:40.771611 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:24:40.771611 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:24:40.771611 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:24:40.771611 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:24:40.771611 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:24:40.771611 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:24:40.771611 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:24:40.771611 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:24:40.771611 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:24:40.771611 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 15:24:40.771611 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:24:40.771611 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 82/153] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 15:24:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 475 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 15:24:40.781669 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-922c0cda-c650-40ee-8cb0-4e210c482875 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:24:40.783898 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-922c0cda-c650-40ee-8cb0-4e210c482875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:40.789352 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a53fa30-899f-452c-944c-d95fb9c20589 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:40.794323 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:40.939528 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 72/154] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:24:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 15:24:41.001535 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922c0cda-c650-40ee-8cb0-4e210c482875 None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:41.007344 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a53fa30-899f-452c-944c-d95fb9c20589 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:41.099029 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be283b4d-02a1-425b-add4-6854ebf73923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:41.101803 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be283b4d-02a1-425b-add4-6854ebf73923 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:41.102608 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be283b4d-02a1-425b-add4-6854ebf73923 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:41.103443 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be283b4d-02a1-425b-add4-6854ebf73923 None admin] PATH_INFO: `/v3/roles` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:41.105199 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be283b4d-02a1-425b-add4-6854ebf73923 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:24:41.106036 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be283b4d-02a1-425b-add4-6854ebf73923 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:41.109487 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be283b4d-02a1-425b-add4-6854ebf73923 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:41.134289 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 83/155] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jul 26 15:24:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:24:41.144809 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be283b4d-02a1-425b-add4-6854ebf73923 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:41.174705 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922c0cda-c650-40ee-8cb0-4e210c482875 None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:41.242071 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5be0909-ad89-4a4f-ae1c-ea84c6a4d281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:41.243666 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5be0909-ad89-4a4f-ae1c-ea84c6a4d281 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:41.244458 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5be0909-ad89-4a4f-ae1c-ea84c6a4d281 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:41.244665 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:41.245334 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5be0909-ad89-4a4f-ae1c-ea84c6a4d281 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:41.262005 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:41.269288 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5be0909-ad89-4a4f-ae1c-ea84c6a4d281 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:24:41.280131 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application [None req-b5be0909-ad89-4a4f-ae1c-ea84c6a4d281 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 15:24:41.280131 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:24:41.280131 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:24:41.280131 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:24:41.280131 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:24:41.280131 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:24:41.280131 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:24:41.280131 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:24:41.280131 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:24:41.280131 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:24:41.280131 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:24:41.280131 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:24:41.280131 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:24:41.280131 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:24:41.280131 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:24:41.280131 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:24:41.284706 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:24:41.284706 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:24:41.284706 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:24:41.284706 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:24:41.284706 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:24:41.284706 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:24:41.284706 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:24:41.284706 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:24:41.284706 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:24:41.284706 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:24:41.284706 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:24:41.284706 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application with Lock( Jul 26 15:24:41.284706 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:24:41.284706 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:24:41.284706 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:24:41.284706 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:24:41.285546 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:24:41.285546 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:24:41.285546 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:24:41.285546 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:24:41.285546 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:24:41.285546 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:24:41.285546 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:24:41.285546 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:24:41.285546 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:24:41.285546 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:24:41.285546 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 15:24:41.285546 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:24:41.285546 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 73/156] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jul 26 15:24:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 15:24:41.292436 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be283b4d-02a1-425b-add4-6854ebf73923 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:41.292999 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5be0909-ad89-4a4f-ae1c-ea84c6a4d281 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:41.334352 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854051ee-eae3-4124-a6bd-83cb691b8ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:41.335022 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854051ee-eae3-4124-a6bd-83cb691b8ecb None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:41.335341 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854051ee-eae3-4124-a6bd-83cb691b8ecb None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:41.335620 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854051ee-eae3-4124-a6bd-83cb691b8ecb None admin] PATH_INFO: `/v3/users/8f10fa4cc3f848d3b7273b748e1545f9` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:41.337644 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854051ee-eae3-4124-a6bd-83cb691b8ecb None admin] RBAC: Authorizing `identity:get_user(user_id=8f10fa4cc3f848d3b7273b748e1545f9)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:41.339604 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854051ee-eae3-4124-a6bd-83cb691b8ecb None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:41.340993 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 84/157] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 26 15:24:41 2022] GET /identity/v3/users/8f10fa4cc3f848d3b7273b748e1545f9 => generated 289 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:24:41.350342 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854051ee-eae3-4124-a6bd-83cb691b8ecb None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:41.475342 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5be0909-ad89-4a4f-ae1c-ea84c6a4d281 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:41.541278 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423f6984-aacd-4000-aa2f-3a28da3ab5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:41.542261 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f6984-aacd-4000-aa2f-3a28da3ab5e0 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:41.542545 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f6984-aacd-4000-aa2f-3a28da3ab5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:41.542831 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f6984-aacd-4000-aa2f-3a28da3ab5e0 None admin] PATH_INFO: `/v3/roles` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:41.543943 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423f6984-aacd-4000-aa2f-3a28da3ab5e0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:24:41.544333 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423f6984-aacd-4000-aa2f-3a28da3ab5e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:41.546079 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423f6984-aacd-4000-aa2f-3a28da3ab5e0 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:41.557374 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 74/158] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 15:24:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:24:41.558748 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81e10c6-a1c2-46a8-983e-5c5ac845b894 None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:41.559077 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81e10c6-a1c2-46a8-983e-5c5ac845b894 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:41.563410 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81e10c6-a1c2-46a8-983e-5c5ac845b894 None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:41.564971 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 75/159] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:24:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:24:41.568231 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81e10c6-a1c2-46a8-983e-5c5ac845b894 None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:41.600584 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854051ee-eae3-4124-a6bd-83cb691b8ecb None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:41.666120 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:41.683990 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7401b68e-4f4a-4c94-a4ab-9dde49c9f23e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:41.684895 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7401b68e-4f4a-4c94-a4ab-9dde49c9f23e None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:41.685338 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7401b68e-4f4a-4c94-a4ab-9dde49c9f23e None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:41.685763 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7401b68e-4f4a-4c94-a4ab-9dde49c9f23e None admin] PATH_INFO: `/v3/projects/e99ebc2f1eb141dc8c8555d0aea0cd1f` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:41.688842 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7401b68e-4f4a-4c94-a4ab-9dde49c9f23e None admin] RBAC: Authorizing `identity:get_project(project_id=e99ebc2f1eb141dc8c8555d0aea0cd1f)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:41.690631 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7401b68e-4f4a-4c94-a4ab-9dde49c9f23e None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:41.692705 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 85/160] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 15:24:41 2022] GET /identity/v3/projects/e99ebc2f1eb141dc8c8555d0aea0cd1f => generated 298 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:24:41.693704 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dfc4f3-4fc1-4973-b0a3-692160ec81f0 None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:41.693990 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dfc4f3-4fc1-4973-b0a3-692160ec81f0 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:41.694273 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dfc4f3-4fc1-4973-b0a3-692160ec81f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:41.716249 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-27dfc4f3-4fc1-4973-b0a3-692160ec81f0 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:24:41.725366 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-27dfc4f3-4fc1-4973-b0a3-692160ec81f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:41.728054 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:41.797005 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 86/161] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:24:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:24:41.797785 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dfc4f3-4fc1-4973-b0a3-692160ec81f0 None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:41.817945 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81e10c6-a1c2-46a8-983e-5c5ac845b894 None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:41.876169 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6301f32e-8bca-404e-9e29-9733a2745cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:41.876968 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6301f32e-8bca-404e-9e29-9733a2745cd3 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:41.877266 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6301f32e-8bca-404e-9e29-9733a2745cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:41.877551 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6301f32e-8bca-404e-9e29-9733a2745cd3 None admin] PATH_INFO: `/v3/users/18673fd27512449ab07302f33ac3c310` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:41.878848 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6301f32e-8bca-404e-9e29-9733a2745cd3 None admin] RBAC: Authorizing `identity:get_user(user_id=18673fd27512449ab07302f33ac3c310)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:41.881524 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6301f32e-8bca-404e-9e29-9733a2745cd3 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:41.883842 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 76/162] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 26 15:24:41 2022] GET /identity/v3/users/18673fd27512449ab07302f33ac3c310 => generated 247 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:24:41.889185 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6301f32e-8bca-404e-9e29-9733a2745cd3 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:41.931007 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dfc4f3-4fc1-4973-b0a3-692160ec81f0 None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:41.964362 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:41.977835 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdadbe54-8cf2-41ba-b7b6-c20d3daaef5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:41.978548 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdadbe54-8cf2-41ba-b7b6-c20d3daaef5f None admin] REQUEST_METHOD: `PUT` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:41.982475 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdadbe54-8cf2-41ba-b7b6-c20d3daaef5f None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:41.982475 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdadbe54-8cf2-41ba-b7b6-c20d3daaef5f None admin] PATH_INFO: `/v3/projects/e99ebc2f1eb141dc8c8555d0aea0cd1f/users/8f10fa4cc3f848d3b7273b748e1545f9/roles/c692edefa26c417c8d43da5d89ec8462` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:41.985357 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdadbe54-8cf2-41ba-b7b6-c20d3daaef5f None admin] RBAC: Authorizing `identity:create_grant(project_id=e99ebc2f1eb141dc8c8555d0aea0cd1f, user_id=8f10fa4cc3f848d3b7273b748e1545f9, role_id=c692edefa26c417c8d43da5d89ec8462)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:41.987950 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdadbe54-8cf2-41ba-b7b6-c20d3daaef5f None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:42.040042 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6301f32e-8bca-404e-9e29-9733a2745cd3 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:42.079119 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 87/163] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jul 26 15:24:41 2022] PUT /identity/v3/projects/e99ebc2f1eb141dc8c8555d0aea0cd1f/users/8f10fa4cc3f848d3b7273b748e1545f9/roles/c692edefa26c417c8d43da5d89ec8462 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:24:42.082834 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdadbe54-8cf2-41ba-b7b6-c20d3daaef5f None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:42.110526 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:42.126112 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c68c98-4768-4406-992a-fc2934d30c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:42.128002 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c68c98-4768-4406-992a-fc2934d30c8e None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:42.128310 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c68c98-4768-4406-992a-fc2934d30c8e None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:42.128597 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c68c98-4768-4406-992a-fc2934d30c8e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:42.153707 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c68c98-4768-4406-992a-fc2934d30c8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:24:42.167590 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application [None req-b7c68c98-4768-4406-992a-fc2934d30c8e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 15:24:42.167590 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:24:42.167590 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:24:42.167590 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:24:42.167590 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:24:42.167590 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:24:42.167590 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:24:42.167590 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:24:42.167590 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:24:42.167590 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:24:42.167590 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:24:42.167590 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:24:42.167590 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:24:42.167590 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:24:42.167590 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:24:42.167590 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:24:42.168902 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:24:42.168902 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:24:42.168902 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:24:42.168902 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:24:42.168902 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:24:42.168902 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:24:42.168902 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:24:42.168902 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:24:42.168902 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:24:42.168902 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:24:42.168902 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:24:42.168902 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application with Lock( Jul 26 15:24:42.168902 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:24:42.168902 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:24:42.168902 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:24:42.168902 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:24:42.171752 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:24:42.171752 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:24:42.171752 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:24:42.171752 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:24:42.171752 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:24:42.171752 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:24:42.171752 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:24:42.171752 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:24:42.171752 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:24:42.171752 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:24:42.171752 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 15:24:42.171752 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:24:42.171752 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 77/164] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jul 26 15:24:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:24:42.184656 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c68c98-4768-4406-992a-fc2934d30c8e None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:42.337109 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdadbe54-8cf2-41ba-b7b6-c20d3daaef5f None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:42.362415 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c68c98-4768-4406-992a-fc2934d30c8e None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:42.414160 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc452a-1514-4040-b386-4ee4f4e86df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:42.414820 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc452a-1514-4040-b386-4ee4f4e86df3 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:42.415107 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc452a-1514-4040-b386-4ee4f4e86df3 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:42.415436 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc452a-1514-4040-b386-4ee4f4e86df3 None admin] PATH_INFO: `/v3/roles` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:42.416209 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fc452a-1514-4040-b386-4ee4f4e86df3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:24:42.416527 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fc452a-1514-4040-b386-4ee4f4e86df3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:42.418049 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fc452a-1514-4040-b386-4ee4f4e86df3 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:42.435531 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 78/165] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 15:24:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:24:42.442381 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc452a-1514-4040-b386-4ee4f4e86df3 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:42.450930 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5cd8ad-c02e-46a2-9236-76cca76c1231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:42.451635 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5cd8ad-c02e-46a2-9236-76cca76c1231 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:42.451926 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5cd8ad-c02e-46a2-9236-76cca76c1231 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:42.452211 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5cd8ad-c02e-46a2-9236-76cca76c1231 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:42.540537 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:42.615795 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:42.634580 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc452a-1514-4040-b386-4ee4f4e86df3 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:42.660075 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5cd8ad-c02e-46a2-9236-76cca76c1231 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:42.661604 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5cd8ad-c02e-46a2-9236-76cca76c1231 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:42.710659 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872ae404-fc66-4984-a7e8-661337f89321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:42.711391 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ae404-fc66-4984-a7e8-661337f89321 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:42.711673 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ae404-fc66-4984-a7e8-661337f89321 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:42.711957 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ae404-fc66-4984-a7e8-661337f89321 None admin] PATH_INFO: `/v3/users/d861ca5a090d4492861528dc158b6822` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:42.713291 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872ae404-fc66-4984-a7e8-661337f89321 None admin] RBAC: Authorizing `identity:get_user(user_id=d861ca5a090d4492861528dc158b6822)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:42.714810 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872ae404-fc66-4984-a7e8-661337f89321 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:42.719077 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 79/166] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 26 15:24:42 2022] GET /identity/v3/users/d861ca5a090d4492861528dc158b6822 => generated 275 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:24:42.725049 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872ae404-fc66-4984-a7e8-661337f89321 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:42.949017 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 88/167] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 15:24:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 870 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 15:24:42.950388 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd73e1-e49b-4d7e-801f-0a13df62ba61 None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:42.950683 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd73e1-e49b-4d7e-801f-0a13df62ba61 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:42.950968 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd73e1-e49b-4d7e-801f-0a13df62ba61 None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:42.952941 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 89/168] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:24:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:24:42.960908 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cd73e1-e49b-4d7e-801f-0a13df62ba61 None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:42.987421 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872ae404-fc66-4984-a7e8-661337f89321 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:43.043691 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:43.070055 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fca4619-db00-4251-9a09-a3f83dde76ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:43.070709 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca4619-db00-4251-9a09-a3f83dde76ab None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:43.070996 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca4619-db00-4251-9a09-a3f83dde76ab None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:43.071309 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca4619-db00-4251-9a09-a3f83dde76ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:43.166517 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:43.200681 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cd73e1-e49b-4d7e-801f-0a13df62ba61 None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:43.260355 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fca4619-db00-4251-9a09-a3f83dde76ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:43.261903 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fca4619-db00-4251-9a09-a3f83dde76ab None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:43.288774 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb9893f-9e44-453e-9cc4-cd6c5990c835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:43.289448 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb9893f-9e44-453e-9cc4-cd6c5990c835 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:43.289741 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb9893f-9e44-453e-9cc4-cd6c5990c835 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:43.291747 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb9893f-9e44-453e-9cc4-cd6c5990c835 None admin] PATH_INFO: `/v3/projects/e99ebc2f1eb141dc8c8555d0aea0cd1f` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:43.292722 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb9893f-9e44-453e-9cc4-cd6c5990c835 None admin] RBAC: Authorizing `identity:get_project(project_id=e99ebc2f1eb141dc8c8555d0aea0cd1f)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:43.294254 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb9893f-9e44-453e-9cc4-cd6c5990c835 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:43.296479 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 90/169] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 15:24:42 2022] GET /identity/v3/projects/e99ebc2f1eb141dc8c8555d0aea0cd1f => generated 298 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:24:43.297905 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a207f0-08bb-4ea5-81e3-38d774ef3a6a None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:43.298193 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a207f0-08bb-4ea5-81e3-38d774ef3a6a None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:43.298464 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a207f0-08bb-4ea5-81e3-38d774ef3a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:43.337659 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-50a207f0-08bb-4ea5-81e3-38d774ef3a6a None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:24:43.338920 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-50a207f0-08bb-4ea5-81e3-38d774ef3a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:43.513224 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 91/170] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:24:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:24:43.513224 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a207f0-08bb-4ea5-81e3-38d774ef3a6a None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:43.582198 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 80/171] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 15:24:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 857 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 15:24:43.582904 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fca4619-db00-4251-9a09-a3f83dde76ab None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:43.635703 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:43.735264 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:43.779041 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a207f0-08bb-4ea5-81e3-38d774ef3a6a None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:43.864638 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851d3392-8f93-4c28-b95a-7dfd8fe07447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:43.866216 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d3392-8f93-4c28-b95a-7dfd8fe07447 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:43.867083 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d3392-8f93-4c28-b95a-7dfd8fe07447 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:43.867999 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d3392-8f93-4c28-b95a-7dfd8fe07447 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:43.869770 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851d3392-8f93-4c28-b95a-7dfd8fe07447 None admin] RBAC: Adding query filter params (role.id=2c659645e15c4204b1457556939397cb, scope.project.id=e99ebc2f1eb141dc8c8555d0aea0cd1f, user.id=18673fd27512449ab07302f33ac3c310) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:24:43.870635 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851d3392-8f93-4c28-b95a-7dfd8fe07447 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:43.873478 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fca4619-db00-4251-9a09-a3f83dde76ab None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:43.873939 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851d3392-8f93-4c28-b95a-7dfd8fe07447 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:43.885937 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 92/172] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 26 15:24:43 2022] GET /identity/v3/role_assignments?user.id=18673fd27512449ab07302f33ac3c310&scope.project.id=e99ebc2f1eb141dc8c8555d0aea0cd1f&role.id=2c659645e15c4204b1457556939397cb => generated 608 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:24:43.887790 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851d3392-8f93-4c28-b95a-7dfd8fe07447 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:43.987311 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e410729-ad20-433f-80db-03c2064bcd3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:43.987998 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e410729-ad20-433f-80db-03c2064bcd3c None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:43.988284 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e410729-ad20-433f-80db-03c2064bcd3c None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:43.988565 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e410729-ad20-433f-80db-03c2064bcd3c None admin] PATH_INFO: `/v3/roles/member` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:44.020749 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e410729-ad20-433f-80db-03c2064bcd3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:24:44.025320 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application [None req-2e410729-ad20-433f-80db-03c2064bcd3c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 15:24:44.025320 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:24:44.025320 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:24:44.025320 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:24:44.025320 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:24:44.025320 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:24:44.025320 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:24:44.025320 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:24:44.025320 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:24:44.025320 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:24:44.025320 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:24:44.025320 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:24:44.025320 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:24:44.025320 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:24:44.025320 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:24:44.025320 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:24:44.027121 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:24:44.027121 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:24:44.027121 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:24:44.027121 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:24:44.027121 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:24:44.027121 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:24:44.027121 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:24:44.027121 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:24:44.027121 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:24:44.027121 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:24:44.027121 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:24:44.027121 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application with Lock( Jul 26 15:24:44.027121 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:24:44.027121 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:24:44.027121 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:24:44.027121 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:24:44.029323 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:24:44.029323 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:24:44.029323 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:24:44.029323 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:24:44.029323 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:24:44.029323 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:24:44.029323 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:24:44.029323 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:24:44.029323 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:24:44.029323 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:24:44.029323 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 15:24:44.029323 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:24:44.029323 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 81/173] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 15:24:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 444 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:24:44.040225 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e410729-ad20-433f-80db-03c2064bcd3c None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:44.115819 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851d3392-8f93-4c28-b95a-7dfd8fe07447 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:44.184062 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd8aa68-577a-4957-bf56-d90f2c1ba6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:44.185737 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd8aa68-577a-4957-bf56-d90f2c1ba6f0 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:44.186517 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd8aa68-577a-4957-bf56-d90f2c1ba6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:44.187890 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd8aa68-577a-4957-bf56-d90f2c1ba6f0 None admin] PATH_INFO: `/v3/projects/e99ebc2f1eb141dc8c8555d0aea0cd1f` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:44.190324 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd8aa68-577a-4957-bf56-d90f2c1ba6f0 None admin] RBAC: Authorizing `identity:get_project(project_id=e99ebc2f1eb141dc8c8555d0aea0cd1f)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:44.193591 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd8aa68-577a-4957-bf56-d90f2c1ba6f0 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:44.197183 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 93/174] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 15:24:43 2022] GET /identity/v3/projects/e99ebc2f1eb141dc8c8555d0aea0cd1f => generated 298 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:24:44.205471 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd8aa68-577a-4957-bf56-d90f2c1ba6f0 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:44.256210 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:44.270275 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:44.339262 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e410729-ad20-433f-80db-03c2064bcd3c None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:44.412402 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd5996f-6990-459a-a780-bdc0f7dccbdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:44.413460 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd5996f-6990-459a-a780-bdc0f7dccbdf None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:44.413989 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd5996f-6990-459a-a780-bdc0f7dccbdf None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:44.414440 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd5996f-6990-459a-a780-bdc0f7dccbdf None admin] PATH_INFO: `/v3/roles` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:44.415809 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd5996f-6990-459a-a780-bdc0f7dccbdf None admin] RBAC: Adding query filter params (name=member) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:24:44.416363 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd5996f-6990-459a-a780-bdc0f7dccbdf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:44.418988 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd5996f-6990-459a-a780-bdc0f7dccbdf None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:44.467083 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 82/175] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jul 26 15:24:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 427 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:24:44.473477 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd5996f-6990-459a-a780-bdc0f7dccbdf None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:44.535819 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd8aa68-577a-4957-bf56-d90f2c1ba6f0 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:44.648794 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f686d2-0202-4984-9446-703952d16c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:44.649522 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f686d2-0202-4984-9446-703952d16c9d None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:44.649817 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f686d2-0202-4984-9446-703952d16c9d None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:44.650103 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f686d2-0202-4984-9446-703952d16c9d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:44.653622 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f686d2-0202-4984-9446-703952d16c9d None admin] RBAC: Adding query filter params (role.id=c86cdde38565431ebacf53dcfc4d863b, scope.project.id=e99ebc2f1eb141dc8c8555d0aea0cd1f, user.id=d861ca5a090d4492861528dc158b6822) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:24:44.653622 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f686d2-0202-4984-9446-703952d16c9d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:44.653622 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f686d2-0202-4984-9446-703952d16c9d None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:44.670310 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 94/176] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 26 15:24:44 2022] GET /identity/v3/role_assignments?user.id=d861ca5a090d4492861528dc158b6822&scope.project.id=e99ebc2f1eb141dc8c8555d0aea0cd1f&role.id=c86cdde38565431ebacf53dcfc4d863b => generated 608 bytes in 466 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:24:44.694484 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd5996f-6990-459a-a780-bdc0f7dccbdf None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:44.800615 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b73a4-6927-4468-8a26-2231f0b96979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:44.802436 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b73a4-6927-4468-8a26-2231f0b96979 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:44.803354 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b73a4-6927-4468-8a26-2231f0b96979 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:44.804132 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b73a4-6927-4468-8a26-2231f0b96979 None admin] PATH_INFO: `/v3/users/d861ca5a090d4492861528dc158b6822` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:44.806592 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380b73a4-6927-4468-8a26-2231f0b96979 None admin] RBAC: Authorizing `identity:get_user(user_id=d861ca5a090d4492861528dc158b6822)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:44.809932 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380b73a4-6927-4468-8a26-2231f0b96979 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:44.814973 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 83/177] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 26 15:24:44 2022] GET /identity/v3/users/d861ca5a090d4492861528dc158b6822 => generated 275 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:24:44.820498 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f686d2-0202-4984-9446-703952d16c9d None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:44.972722 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:44.995048 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f686d2-0202-4984-9446-703952d16c9d None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:45.043200 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542e0a5b-8ca9-405e-8b6c-1fba303d54e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:45.043870 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e0a5b-8ca9-405e-8b6c-1fba303d54e5 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:45.044158 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e0a5b-8ca9-405e-8b6c-1fba303d54e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:45.044698 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e0a5b-8ca9-405e-8b6c-1fba303d54e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:45.190410 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542e0a5b-8ca9-405e-8b6c-1fba303d54e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:45.193047 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542e0a5b-8ca9-405e-8b6c-1fba303d54e5 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:45.248764 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5275650e-b9f7-4d9d-8d7a-a59e55cd6a55 None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:45.250295 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5275650e-b9f7-4d9d-8d7a-a59e55cd6a55 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:45.250833 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5275650e-b9f7-4d9d-8d7a-a59e55cd6a55 None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:45.253478 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 84/178] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:24:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:24:45.263309 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a6d2f-776b-4ddd-92b3-0af020defe6c None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:45.263687 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a6d2f-776b-4ddd-92b3-0af020defe6c None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:45.264081 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a6d2f-776b-4ddd-92b3-0af020defe6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:45.329339 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-d18a6d2f-776b-4ddd-92b3-0af020defe6c None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:24:45.334650 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-d18a6d2f-776b-4ddd-92b3-0af020defe6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:45.344070 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:45.425922 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:45.460556 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 95/179] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 15:24:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 641 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 26 15:24:45.466752 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542e0a5b-8ca9-405e-8b6c-1fba303d54e5 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:45.492705 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 85/180] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:24:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:24:45.530114 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a62d06-96dd-4291-8fb9-657685ced8b6 None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:45.531164 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a62d06-96dd-4291-8fb9-657685ced8b6 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:45.531698 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a62d06-96dd-4291-8fb9-657685ced8b6 None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:45.538455 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 86/181] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:24:45 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:24:45.545421 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3497aea-b6ea-4a6e-ac67-17b8488f7571 None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:45.545999 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3497aea-b6ea-4a6e-ac67-17b8488f7571 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:45.547068 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3497aea-b6ea-4a6e-ac67-17b8488f7571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:45.585465 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-e3497aea-b6ea-4a6e-ac67-17b8488f7571 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:24:45.589984 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-e3497aea-b6ea-4a6e-ac67-17b8488f7571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:45.628591 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542e0a5b-8ca9-405e-8b6c-1fba303d54e5 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:45.671026 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca669608-b743-4733-96ea-8a03c5dde830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:45.672653 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca669608-b743-4733-96ea-8a03c5dde830 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:45.673163 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca669608-b743-4733-96ea-8a03c5dde830 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:45.673662 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca669608-b743-4733-96ea-8a03c5dde830 None admin] PATH_INFO: `/v3/projects/5706c7a1aec5405294f04a88c93deec0` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:45.675541 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca669608-b743-4733-96ea-8a03c5dde830 None admin] RBAC: Authorizing `identity:get_project(project_id=5706c7a1aec5405294f04a88c93deec0)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:45.677859 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca669608-b743-4733-96ea-8a03c5dde830 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:45.680298 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 96/182] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 15:24:45 2022] GET /identity/v3/projects/5706c7a1aec5405294f04a88c93deec0 => generated 312 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:24:45.681382 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca669608-b743-4733-96ea-8a03c5dde830 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:45.725203 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 87/183] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:24:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:24:45.726519 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3497aea-b6ea-4a6e-ac67-17b8488f7571 None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:45.771218 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:45.835928 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca669608-b743-4733-96ea-8a03c5dde830 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:45.842865 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:45.879614 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59151590-ecf9-458d-8a47-f50573ab536a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:45.880283 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59151590-ecf9-458d-8a47-f50573ab536a None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:45.880558 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59151590-ecf9-458d-8a47-f50573ab536a None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:45.880925 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59151590-ecf9-458d-8a47-f50573ab536a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:45.885627 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3497aea-b6ea-4a6e-ac67-17b8488f7571 None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:45.893972 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59151590-ecf9-458d-8a47-f50573ab536a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:24:45.899175 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-59151590-ecf9-458d-8a47-f50573ab536a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 15:24:45.899175 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:24:45.899175 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:24:45.899175 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:24:45.899175 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:24:45.899175 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:24:45.899175 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:24:45.899175 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:24:45.899175 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:24:45.899175 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:24:45.899175 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:24:45.899175 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:24:45.899175 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:24:45.899175 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:24:45.899175 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:24:45.899175 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:24:45.900177 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:24:45.900177 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:24:45.900177 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:24:45.900177 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:24:45.900177 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:24:45.900177 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:24:45.900177 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:24:45.900177 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:24:45.900177 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:24:45.900177 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:24:45.900177 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:24:45.900177 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:24:45.900177 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:24:45.900177 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:24:45.900177 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:24:45.900177 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:24:45.904487 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:24:45.904487 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:24:45.904487 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:24:45.904487 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:24:45.904487 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:24:45.904487 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:24:45.904487 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:24:45.904487 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:24:45.904487 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:24:45.904487 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:24:45.904487 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 15:24:45.904487 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:24:45.904487 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 97/184] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jul 26 15:24:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:24:45.904487 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59151590-ecf9-458d-8a47-f50573ab536a None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:45.941254 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9ed6d5-28b3-4b4b-9c2b-3f89e4bf410f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:45.942158 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ed6d5-28b3-4b4b-9c2b-3f89e4bf410f None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:45.942506 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ed6d5-28b3-4b4b-9c2b-3f89e4bf410f None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:45.942853 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ed6d5-28b3-4b4b-9c2b-3f89e4bf410f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:45.943806 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9ed6d5-28b3-4b4b-9c2b-3f89e4bf410f None admin] RBAC: Adding query filter params (role.id=fd8f80bccab248edbb1d09ec187a8113, scope.project.id=5706c7a1aec5405294f04a88c93deec0, user.id=d861ca5a090d4492861528dc158b6822) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:24:45.944189 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9ed6d5-28b3-4b4b-9c2b-3f89e4bf410f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:45.945768 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9ed6d5-28b3-4b4b-9c2b-3f89e4bf410f None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:45.953892 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 88/185] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 26 15:24:45 2022] GET /identity/v3/role_assignments?user.id=d861ca5a090d4492861528dc158b6822&scope.project.id=5706c7a1aec5405294f04a88c93deec0&role.id=fd8f80bccab248edbb1d09ec187a8113 => generated 608 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:24:45.955432 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e9fd25-c3c7-47f1-8e9a-4dccc38aa9d0 None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:45.955798 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e9fd25-c3c7-47f1-8e9a-4dccc38aa9d0 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:45.956178 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e9fd25-c3c7-47f1-8e9a-4dccc38aa9d0 None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:45.958425 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 89/186] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:24:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:24:45.959222 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e9fd25-c3c7-47f1-8e9a-4dccc38aa9d0 None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:46.067633 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59151590-ecf9-458d-8a47-f50573ab536a None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:46.091285 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:46.135482 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e9fd25-c3c7-47f1-8e9a-4dccc38aa9d0 None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:46.142735 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d73dd5-4793-47ea-ac13-9216e747b8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:46.144065 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d73dd5-4793-47ea-ac13-9216e747b8ba None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:46.144646 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d73dd5-4793-47ea-ac13-9216e747b8ba None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:46.145218 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d73dd5-4793-47ea-ac13-9216e747b8ba None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:46.167898 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d73dd5-4793-47ea-ac13-9216e747b8ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:24:46.179776 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-09d73dd5-4793-47ea-ac13-9216e747b8ba None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 15:24:46.179776 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:24:46.179776 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:24:46.179776 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:24:46.179776 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:24:46.179776 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:24:46.179776 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:24:46.179776 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:24:46.179776 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:24:46.179776 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:24:46.179776 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:24:46.179776 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:24:46.179776 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:24:46.179776 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:24:46.179776 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:24:46.179776 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:24:46.180834 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:24:46.180834 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:24:46.180834 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:24:46.180834 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:24:46.180834 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:24:46.180834 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:24:46.180834 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:24:46.180834 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:24:46.180834 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:24:46.180834 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:24:46.180834 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:24:46.180834 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:24:46.180834 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:24:46.180834 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:24:46.180834 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:24:46.180834 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:24:46.181632 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:24:46.181632 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:24:46.181632 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:24:46.181632 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:24:46.181632 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:24:46.181632 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:24:46.181632 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:24:46.181632 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:24:46.181632 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:24:46.181632 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:24:46.181632 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 15:24:46.181632 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:24:46.182231 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 98/187] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jul 26 15:24:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:24:46.185236 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e478de5-5704-4d36-a21d-1035746e2da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:46.186201 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e478de5-5704-4d36-a21d-1035746e2da3 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:46.187273 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e478de5-5704-4d36-a21d-1035746e2da3 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:46.187903 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e478de5-5704-4d36-a21d-1035746e2da3 None admin] PATH_INFO: `/v3/roles` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:46.188900 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e478de5-5704-4d36-a21d-1035746e2da3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:24:46.189428 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e478de5-5704-4d36-a21d-1035746e2da3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:46.191297 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e478de5-5704-4d36-a21d-1035746e2da3 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:46.192726 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c413824-b466-414c-9847-0c263c877492 None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:46.193256 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c413824-b466-414c-9847-0c263c877492 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:46.194174 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:46.194832 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c413824-b466-414c-9847-0c263c877492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:46.203453 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 90/188] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 15:24:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:24:46.213759 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e478de5-5704-4d36-a21d-1035746e2da3 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:46.224206 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-5c413824-b466-414c-9847-0c263c877492 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:24:46.225480 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-5c413824-b466-414c-9847-0c263c877492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:46.321592 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 99/189] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:24:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:24:46.322935 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ecd2a-55c1-406c-9cdd-6e26e84a362e None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:46.323372 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ecd2a-55c1-406c-9cdd-6e26e84a362e None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:46.323653 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ecd2a-55c1-406c-9cdd-6e26e84a362e None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:46.325158 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 100/190] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:24:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:24:46.325786 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2ecd2a-55c1-406c-9cdd-6e26e84a362e None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:46.360123 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e478de5-5704-4d36-a21d-1035746e2da3 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:46.399428 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001485fb-45e5-4764-83ec-88863fcf15fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:46.400064 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001485fb-45e5-4764-83ec-88863fcf15fd None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:46.400347 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001485fb-45e5-4764-83ec-88863fcf15fd None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:46.400625 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001485fb-45e5-4764-83ec-88863fcf15fd None admin] PATH_INFO: `/v3/roles` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:46.401358 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001485fb-45e5-4764-83ec-88863fcf15fd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:24:46.401668 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001485fb-45e5-4764-83ec-88863fcf15fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:46.403097 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001485fb-45e5-4764-83ec-88863fcf15fd None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:46.413124 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 91/191] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 15:24:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:24:46.414725 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ef18d-9880-4e3b-8317-cf13603b614e None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:46.415186 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ef18d-9880-4e3b-8317-cf13603b614e None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:46.415593 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ef18d-9880-4e3b-8317-cf13603b614e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:46.437458 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-273ef18d-9880-4e3b-8317-cf13603b614e None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:24:46.438797 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-273ef18d-9880-4e3b-8317-cf13603b614e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:46.459537 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:46.465515 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2ecd2a-55c1-406c-9cdd-6e26e84a362e None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:46.510245 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:46.512001 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d51ca5-ed8e-416c-9074-0c0198aeb0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:46.512892 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d51ca5-ed8e-416c-9074-0c0198aeb0ff None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:46.513248 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d51ca5-ed8e-416c-9074-0c0198aeb0ff None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:46.513618 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d51ca5-ed8e-416c-9074-0c0198aeb0ff None admin] PATH_INFO: `/v3/users/13bac95ef0094f938a977f6819031f7e` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:46.527471 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 92/192] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:24:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:24:46.528360 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273ef18d-9880-4e3b-8317-cf13603b614e None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:46.531411 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d51ca5-ed8e-416c-9074-0c0198aeb0ff None admin] RBAC: Authorizing `identity:get_user(user_id=13bac95ef0094f938a977f6819031f7e)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:46.534386 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d51ca5-ed8e-416c-9074-0c0198aeb0ff None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:46.536562 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 101/193] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 26 15:24:46 2022] GET /identity/v3/users/13bac95ef0094f938a977f6819031f7e => generated 283 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:24:46.537531 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d51ca5-ed8e-416c-9074-0c0198aeb0ff None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:46.661540 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d51ca5-ed8e-416c-9074-0c0198aeb0ff None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:46.661733 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273ef18d-9880-4e3b-8317-cf13603b614e None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:46.703936 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c65db38-f258-4080-aefe-555dc727480b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:46.704488 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed6edd0-729b-4339-843a-a98c16d448bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:46.704678 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c65db38-f258-4080-aefe-555dc727480b None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:46.704886 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c65db38-f258-4080-aefe-555dc727480b None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:46.705169 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c65db38-f258-4080-aefe-555dc727480b None admin] PATH_INFO: `/v3/domains/default` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:46.705460 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6edd0-729b-4339-843a-a98c16d448bb None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:46.705891 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6edd0-729b-4339-843a-a98c16d448bb None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:46.706298 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6edd0-729b-4339-843a-a98c16d448bb None admin] PATH_INFO: `/v3/users/13bac95ef0094f938a977f6819031f7e` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:46.706455 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c65db38-f258-4080-aefe-555dc727480b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:46.707964 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed6edd0-729b-4339-843a-a98c16d448bb None admin] RBAC: Authorizing `identity:get_user(user_id=13bac95ef0094f938a977f6819031f7e)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:46.708190 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c65db38-f258-4080-aefe-555dc727480b None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:46.710091 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed6edd0-729b-4339-843a-a98c16d448bb None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:46.710264 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 93/194] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 15:24:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:24:46.717326 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 102/195] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 26 15:24:46 2022] GET /identity/v3/users/13bac95ef0094f938a977f6819031f7e => generated 283 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:24:46.717326 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed6edd0-729b-4339-843a-a98c16d448bb None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:46.717698 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c65db38-f258-4080-aefe-555dc727480b None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:46.767190 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:46.802957 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:46.851436 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed6edd0-729b-4339-843a-a98c16d448bb None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:46.852090 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c65db38-f258-4080-aefe-555dc727480b None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:46.888996 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1483b42-6ab9-44dd-8bfc-46ea04242e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:46.890267 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1483b42-6ab9-44dd-8bfc-46ea04242e72 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:46.890648 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1483b42-6ab9-44dd-8bfc-46ea04242e72 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:46.890983 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1483b42-6ab9-44dd-8bfc-46ea04242e72 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:46.891079 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b8569e-71db-40dc-9051-93fd79ab7932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:46.891683 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b8569e-71db-40dc-9051-93fd79ab7932 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:46.891963 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b8569e-71db-40dc-9051-93fd79ab7932 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:46.892232 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b8569e-71db-40dc-9051-93fd79ab7932 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:46.903649 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1483b42-6ab9-44dd-8bfc-46ea04242e72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:24:46.909953 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-d1483b42-6ab9-44dd-8bfc-46ea04242e72 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 15:24:46.909953 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:24:46.909953 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:24:46.909953 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:24:46.909953 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:24:46.909953 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:24:46.909953 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:24:46.909953 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:24:46.909953 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:24:46.909953 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:24:46.909953 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:24:46.909953 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:24:46.909953 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:24:46.909953 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:24:46.909953 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:24:46.909953 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:24:46.910882 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:24:46.910882 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:24:46.910882 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:24:46.910882 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:24:46.910882 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:24:46.910882 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:24:46.910882 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:24:46.910882 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:24:46.910882 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:24:46.910882 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:24:46.910882 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:24:46.910882 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:24:46.910882 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:24:46.910882 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:24:46.910882 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:24:46.910882 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:24:46.911937 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:24:46.911937 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:24:46.911937 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:24:46.911937 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:24:46.911937 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:24:46.911937 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:24:46.911937 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:24:46.911937 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:24:46.911937 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:24:46.911937 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:24:46.911937 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 15:24:46.911937 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:24:46.911937 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 103/196] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 15:24:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:24:46.911937 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1483b42-6ab9-44dd-8bfc-46ea04242e72 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:46.981372 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b8569e-71db-40dc-9051-93fd79ab7932 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:46.982929 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b8569e-71db-40dc-9051-93fd79ab7932 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:47.020796 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:47.037539 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1483b42-6ab9-44dd-8bfc-46ea04242e72 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:47.047625 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:47.075639 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad582c8-5479-49d1-8759-a9b36f5b1f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:47.076265 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad582c8-5479-49d1-8759-a9b36f5b1f75 None admin] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:47.076544 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad582c8-5479-49d1-8759-a9b36f5b1f75 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:47.076823 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad582c8-5479-49d1-8759-a9b36f5b1f75 None admin] PATH_INFO: `/v3/users` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:47.077557 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad582c8-5479-49d1-8759-a9b36f5b1f75 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:47.079245 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad582c8-5479-49d1-8759-a9b36f5b1f75 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:47.103071 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 94/197] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 15:24:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 15:24:47.103987 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b8569e-71db-40dc-9051-93fd79ab7932 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:47.157289 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 104/198] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Jul 26 15:24:46 2022] POST /identity/v3/users => generated 297 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:24:47.158227 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad582c8-5479-49d1-8759-a9b36f5b1f75 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:47.237512 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b8569e-71db-40dc-9051-93fd79ab7932 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:47.296756 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d8b7ab-98d5-434a-8db2-dc3b1a91a4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:47.297641 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d8b7ab-98d5-434a-8db2-dc3b1a91a4df None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:47.298184 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d8b7ab-98d5-434a-8db2-dc3b1a91a4df None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:47.298726 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d8b7ab-98d5-434a-8db2-dc3b1a91a4df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:47.314766 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad582c8-5479-49d1-8759-a9b36f5b1f75 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:47.336236 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:47.368091 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5e87c6-0669-40ed-960e-5f6db5e903d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:47.368347 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e87c6-0669-40ed-960e-5f6db5e903d7 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:47.368778 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e87c6-0669-40ed-960e-5f6db5e903d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:47.369314 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e87c6-0669-40ed-960e-5f6db5e903d7 None admin] PATH_INFO: `/v3/roles` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:47.370507 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5e87c6-0669-40ed-960e-5f6db5e903d7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:24:47.370938 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5e87c6-0669-40ed-960e-5f6db5e903d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:47.374880 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5e87c6-0669-40ed-960e-5f6db5e903d7 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:47.387196 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 105/199] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jul 26 15:24:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:24:47.388998 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5e87c6-0669-40ed-960e-5f6db5e903d7 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:47.394635 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:47.405918 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d8b7ab-98d5-434a-8db2-dc3b1a91a4df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:47.408142 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d8b7ab-98d5-434a-8db2-dc3b1a91a4df None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:47.581526 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5e87c6-0669-40ed-960e-5f6db5e903d7 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:47.610844 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 95/200] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 15:24:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 15:24:47.612654 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d8b7ab-98d5-434a-8db2-dc3b1a91a4df None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:47.654250 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7665970c-429b-4d57-98da-1fae312c6de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:47.655915 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7665970c-429b-4d57-98da-1fae312c6de3 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:47.659637 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7665970c-429b-4d57-98da-1fae312c6de3 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:47.659637 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7665970c-429b-4d57-98da-1fae312c6de3 None admin] PATH_INFO: `/v3/projects/24c3fa325d8a41dc8ac86599b7fb5180` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:47.659637 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7665970c-429b-4d57-98da-1fae312c6de3 None admin] RBAC: Authorizing `identity:get_project(project_id=24c3fa325d8a41dc8ac86599b7fb5180)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:47.661758 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7665970c-429b-4d57-98da-1fae312c6de3 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:47.664911 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 106/201] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 15:24:47 2022] GET /identity/v3/projects/24c3fa325d8a41dc8ac86599b7fb5180 => generated 302 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:24:47.666525 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7665970c-429b-4d57-98da-1fae312c6de3 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:47.744541 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:47.814340 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:47.849629 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d8b7ab-98d5-434a-8db2-dc3b1a91a4df None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:47.882554 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7665970c-429b-4d57-98da-1fae312c6de3 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:47.923091 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bde0f60-ccb5-4836-9819-e6871f4c5a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:47.924441 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde0f60-ccb5-4836-9819-e6871f4c5a8f None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:47.925141 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde0f60-ccb5-4836-9819-e6871f4c5a8f None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:47.925629 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde0f60-ccb5-4836-9819-e6871f4c5a8f None admin] PATH_INFO: `/v3/users/8f10fa4cc3f848d3b7273b748e1545f9` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:47.927927 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bde0f60-ccb5-4836-9819-e6871f4c5a8f None admin] RBAC: Authorizing `identity:get_user(user_id=8f10fa4cc3f848d3b7273b748e1545f9)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:47.930531 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bde0f60-ccb5-4836-9819-e6871f4c5a8f None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:47.938554 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 96/202] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 26 15:24:47 2022] GET /identity/v3/users/8f10fa4cc3f848d3b7273b748e1545f9 => generated 289 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:24:47.940470 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bde0f60-ccb5-4836-9819-e6871f4c5a8f None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:47.964753 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1721194-4532-4f6e-a717-46f2ec7783bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:47.966661 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1721194-4532-4f6e-a717-46f2ec7783bd None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:47.967382 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1721194-4532-4f6e-a717-46f2ec7783bd None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:47.968952 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1721194-4532-4f6e-a717-46f2ec7783bd None admin] PATH_INFO: `/v3/projects/24c3fa325d8a41dc8ac86599b7fb5180` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:47.971200 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1721194-4532-4f6e-a717-46f2ec7783bd None admin] RBAC: Authorizing `identity:get_project(project_id=24c3fa325d8a41dc8ac86599b7fb5180)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:47.974923 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1721194-4532-4f6e-a717-46f2ec7783bd None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:47.979723 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 107/203] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 15:24:47 2022] GET /identity/v3/projects/24c3fa325d8a41dc8ac86599b7fb5180 => generated 302 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:24:47.982339 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1721194-4532-4f6e-a717-46f2ec7783bd None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:48.178179 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bde0f60-ccb5-4836-9819-e6871f4c5a8f None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:48.217407 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1721194-4532-4f6e-a717-46f2ec7783bd None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:48.235797 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:48.254408 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48df5d13-2237-418f-9e4b-1324318c383e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:48.255529 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df5d13-2237-418f-9e4b-1324318c383e None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:48.256028 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df5d13-2237-418f-9e4b-1324318c383e None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:48.256559 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df5d13-2237-418f-9e4b-1324318c383e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:48.257876 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48df5d13-2237-418f-9e4b-1324318c383e None admin] RBAC: Adding query filter params (role.id=2c659645e15c4204b1457556939397cb, scope.project.id=24c3fa325d8a41dc8ac86599b7fb5180, user.id=13bac95ef0094f938a977f6819031f7e) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:24:48.258569 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48df5d13-2237-418f-9e4b-1324318c383e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:48.261148 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48df5d13-2237-418f-9e4b-1324318c383e None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:48.279188 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 97/204] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 26 15:24:47 2022] GET /identity/v3/role_assignments?user.id=13bac95ef0094f938a977f6819031f7e&scope.project.id=24c3fa325d8a41dc8ac86599b7fb5180&role.id=2c659645e15c4204b1457556939397cb => generated 259 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:24:48.281818 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48df5d13-2237-418f-9e4b-1324318c383e None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:48.309050 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f347f312-075f-4bcf-965d-70a428313753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:48.310114 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f347f312-075f-4bcf-965d-70a428313753 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:48.310607 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f347f312-075f-4bcf-965d-70a428313753 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:48.311080 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f347f312-075f-4bcf-965d-70a428313753 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:48.353714 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:48.597024 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f347f312-075f-4bcf-965d-70a428313753 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:48.599733 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f347f312-075f-4bcf-965d-70a428313753 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:48.780096 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48df5d13-2237-418f-9e4b-1324318c383e None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:48.820268 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 108/205] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 15:24:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 840 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 15:24:48.828933 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f347f312-075f-4bcf-965d-70a428313753 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:48.875800 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75290f32-084d-4323-b2d1-1ab46185b67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:48.876803 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75290f32-084d-4323-b2d1-1ab46185b67f None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:48.877318 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75290f32-084d-4323-b2d1-1ab46185b67f None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:48.877816 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75290f32-084d-4323-b2d1-1ab46185b67f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:48.879608 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75290f32-084d-4323-b2d1-1ab46185b67f None admin] RBAC: Adding query filter params (role.id=c86cdde38565431ebacf53dcfc4d863b, scope.project.id=24c3fa325d8a41dc8ac86599b7fb5180, user.id=13bac95ef0094f938a977f6819031f7e) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:24:48.880206 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75290f32-084d-4323-b2d1-1ab46185b67f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:48.883286 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75290f32-084d-4323-b2d1-1ab46185b67f None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:48.895390 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 98/206] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 26 15:24:48 2022] GET /identity/v3/role_assignments?user.id=13bac95ef0094f938a977f6819031f7e&scope.project.id=24c3fa325d8a41dc8ac86599b7fb5180&role.id=c86cdde38565431ebacf53dcfc4d863b => generated 259 bytes in 616 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:24:48.957481 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:49.111095 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f347f312-075f-4bcf-965d-70a428313753 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:49.204735 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa266100-1f21-4b7e-93d2-78f9ece3302e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:49.205928 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa266100-1f21-4b7e-93d2-78f9ece3302e None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:49.206440 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa266100-1f21-4b7e-93d2-78f9ece3302e None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:49.206929 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa266100-1f21-4b7e-93d2-78f9ece3302e None admin] PATH_INFO: `/v3/projects/e99ebc2f1eb141dc8c8555d0aea0cd1f` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:49.212668 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa266100-1f21-4b7e-93d2-78f9ece3302e None admin] RBAC: Authorizing `identity:get_project(project_id=e99ebc2f1eb141dc8c8555d0aea0cd1f)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:49.215650 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa266100-1f21-4b7e-93d2-78f9ece3302e None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:49.219617 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 109/207] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 15:24:48 2022] GET /identity/v3/projects/e99ebc2f1eb141dc8c8555d0aea0cd1f => generated 298 bytes in 392 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:24:49.226164 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75290f32-084d-4323-b2d1-1ab46185b67f None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:49.366337 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:49.446674 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75290f32-084d-4323-b2d1-1ab46185b67f None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:49.497764 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a1bf5a-d0b0-432a-be97-5b5fbddcd122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:49.498307 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a1bf5a-d0b0-432a-be97-5b5fbddcd122 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:49.498638 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a1bf5a-d0b0-432a-be97-5b5fbddcd122 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:49.499556 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a1bf5a-d0b0-432a-be97-5b5fbddcd122 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:49.500379 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a1bf5a-d0b0-432a-be97-5b5fbddcd122 None admin] RBAC: Adding query filter params (role.id=c692edefa26c417c8d43da5d89ec8462, scope.project.id=e99ebc2f1eb141dc8c8555d0aea0cd1f, user.id=8f10fa4cc3f848d3b7273b748e1545f9) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:24:49.500735 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a1bf5a-d0b0-432a-be97-5b5fbddcd122 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:49.502209 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a1bf5a-d0b0-432a-be97-5b5fbddcd122 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:49.512678 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 99/208] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 26 15:24:49 2022] GET /identity/v3/role_assignments?user.id=8f10fa4cc3f848d3b7273b748e1545f9&scope.project.id=e99ebc2f1eb141dc8c8555d0aea0cd1f&role.id=c692edefa26c417c8d43da5d89ec8462 => generated 608 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:24:50.325952 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f9320-dc0c-4f6a-921b-2e44bf8b72c7 None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:50.326474 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f9320-dc0c-4f6a-921b-2e44bf8b72c7 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:50.326548 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f9320-dc0c-4f6a-921b-2e44bf8b72c7 None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:50.327947 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 110/209] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:24:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:24:50.333673 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8605e-ea15-47fc-b591-38ac16c9b706 None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:50.334177 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8605e-ea15-47fc-b591-38ac16c9b706 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:50.334437 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8605e-ea15-47fc-b591-38ac16c9b706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:50.354440 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-5fe8605e-ea15-47fc-b591-38ac16c9b706 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:24:50.355727 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-5fe8605e-ea15-47fc-b591-38ac16c9b706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:50.460854 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd1311-4573-4e47-a814-88517231b124 None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:50.461490 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd1311-4573-4e47-a814-88517231b124 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:50.461915 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd1311-4573-4e47-a814-88517231b124 None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:50.463613 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 111/210] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:24:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:24:50.468049 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 100/211] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:24:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:24:50.470371 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0739ed8a-d3a2-4652-befb-547690caeaef None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:50.470868 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0739ed8a-d3a2-4652-befb-547690caeaef None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:50.471424 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0739ed8a-d3a2-4652-befb-547690caeaef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:50.492228 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-0739ed8a-d3a2-4652-befb-547690caeaef None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:24:50.493789 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-0739ed8a-d3a2-4652-befb-547690caeaef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:50.519775 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe8605e-ea15-47fc-b591-38ac16c9b706 None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:50.595543 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 112/212] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:24:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:24:50.621459 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0739ed8a-d3a2-4652-befb-547690caeaef None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:50.633285 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:50.682286 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:50.747433 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe8605e-ea15-47fc-b591-38ac16c9b706 None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:50.794752 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0739ed8a-d3a2-4652-befb-547690caeaef None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:50.799636 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fcbde6-c5d7-4dd2-bc48-dc0d49e054f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:50.800500 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fcbde6-c5d7-4dd2-bc48-dc0d49e054f6 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:50.802163 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fcbde6-c5d7-4dd2-bc48-dc0d49e054f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:50.802163 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fcbde6-c5d7-4dd2-bc48-dc0d49e054f6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:50.815890 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fcbde6-c5d7-4dd2-bc48-dc0d49e054f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:24:50.821342 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application [None req-77fcbde6-c5d7-4dd2-bc48-dc0d49e054f6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 15:24:50.821342 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:24:50.821342 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:24:50.821342 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:24:50.821342 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:24:50.821342 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:24:50.821342 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:24:50.821342 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:24:50.821342 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:24:50.821342 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:24:50.821342 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:24:50.821342 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:24:50.821342 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:24:50.821342 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:24:50.821342 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:24:50.821342 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:24:50.822899 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:24:50.822899 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:24:50.822899 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:24:50.822899 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:24:50.822899 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:24:50.822899 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:24:50.822899 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:24:50.822899 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:24:50.822899 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:24:50.822899 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:24:50.822899 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:24:50.822899 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application with Lock( Jul 26 15:24:50.822899 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:24:50.822899 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:24:50.822899 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:24:50.822899 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:24:50.824363 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:24:50.824363 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:24:50.824363 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:24:50.824363 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:24:50.824363 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:24:50.824363 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:24:50.824363 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:24:50.824363 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:24:50.824363 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:24:50.824363 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:24:50.824363 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 15:24:50.824363 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:24:50.828120 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 101/213] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 15:24:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 15:24:50.829870 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fcbde6-c5d7-4dd2-bc48-dc0d49e054f6 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:50.883964 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e852d1c3-c371-47f8-8cf1-524cf490ded5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:50.885594 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e852d1c3-c371-47f8-8cf1-524cf490ded5 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:50.886449 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e852d1c3-c371-47f8-8cf1-524cf490ded5 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:50.887341 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e852d1c3-c371-47f8-8cf1-524cf490ded5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:50.890604 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e852d1c3-c371-47f8-8cf1-524cf490ded5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:50.894025 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e852d1c3-c371-47f8-8cf1-524cf490ded5 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:50.898128 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 113/214] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 15:24:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:24:50.905178 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e852d1c3-c371-47f8-8cf1-524cf490ded5 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:51.022960 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fcbde6-c5d7-4dd2-bc48-dc0d49e054f6 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:51.037015 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e852d1c3-c371-47f8-8cf1-524cf490ded5 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:51.039908 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:51.047719 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:51.079383 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a4ef61-c383-4d12-8bb6-e76750e8153d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:51.080379 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a4ef61-c383-4d12-8bb6-e76750e8153d None admin] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:51.080838 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a4ef61-c383-4d12-8bb6-e76750e8153d None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:51.081269 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a4ef61-c383-4d12-8bb6-e76750e8153d None admin] PATH_INFO: `/v3/users` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:51.082132 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a4ef61-c383-4d12-8bb6-e76750e8153d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:51.083825 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a4ef61-c383-4d12-8bb6-e76750e8153d None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:51.097037 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b64a4fa-4ad8-4fdc-8eb7-3d7f38bbd84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:51.098329 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b64a4fa-4ad8-4fdc-8eb7-3d7f38bbd84b None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:51.098851 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b64a4fa-4ad8-4fdc-8eb7-3d7f38bbd84b None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:51.099466 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b64a4fa-4ad8-4fdc-8eb7-3d7f38bbd84b None admin] PATH_INFO: `/v3/roles` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:51.100856 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b64a4fa-4ad8-4fdc-8eb7-3d7f38bbd84b None admin] RBAC: Adding query filter params (name=member) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:24:51.101531 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b64a4fa-4ad8-4fdc-8eb7-3d7f38bbd84b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:51.104227 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b64a4fa-4ad8-4fdc-8eb7-3d7f38bbd84b None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:51.123202 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 102/215] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jul 26 15:24:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:24:51.128772 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b64a4fa-4ad8-4fdc-8eb7-3d7f38bbd84b None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:51.219202 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 114/216] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Jul 26 15:24:50 2022] POST /identity/v3/users => generated 297 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:24:51.296782 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b64a4fa-4ad8-4fdc-8eb7-3d7f38bbd84b None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:51.342949 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d3072b-6ec5-464e-9309-0abbaf216ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:51.343917 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d3072b-6ec5-464e-9309-0abbaf216ab3 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:51.344246 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d3072b-6ec5-464e-9309-0abbaf216ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:51.344492 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d3072b-6ec5-464e-9309-0abbaf216ab3 None admin] PATH_INFO: `/v3/users/9e0e095c863d436fa8ff95625f8a10f2` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:51.370793 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d3072b-6ec5-464e-9309-0abbaf216ab3 None admin] RBAC: Authorizing `identity:get_user(user_id=9e0e095c863d436fa8ff95625f8a10f2)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:51.372407 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d3072b-6ec5-464e-9309-0abbaf216ab3 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:51.377168 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 103/217] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 26 15:24:51 2022] GET /identity/v3/users/9e0e095c863d436fa8ff95625f8a10f2 => generated 297 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:24:51.383527 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a4ef61-c383-4d12-8bb6-e76750e8153d None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:51.598717 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a4ef61-c383-4d12-8bb6-e76750e8153d None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:51.646925 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c23a0e-4c08-4714-8382-7cacab68da04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:51.648084 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c23a0e-4c08-4714-8382-7cacab68da04 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:51.648631 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c23a0e-4c08-4714-8382-7cacab68da04 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:51.652632 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c23a0e-4c08-4714-8382-7cacab68da04 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:51.711186 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:51.769984 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c23a0e-4c08-4714-8382-7cacab68da04 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:51.773058 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c23a0e-4c08-4714-8382-7cacab68da04 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:51.816832 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df937179-5e11-4ef2-a052-019180b6aa77 None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:51.817490 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df937179-5e11-4ef2-a052-019180b6aa77 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:51.817980 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df937179-5e11-4ef2-a052-019180b6aa77 None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:51.819745 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 104/218] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:24:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:24:51.830052 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda659d7-4a87-4a35-94e4-2f9e65088f09 None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:51.830549 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda659d7-4a87-4a35-94e4-2f9e65088f09 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:51.831036 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda659d7-4a87-4a35-94e4-2f9e65088f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:51.861425 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-cda659d7-4a87-4a35-94e4-2f9e65088f09 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:24:51.863484 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-cda659d7-4a87-4a35-94e4-2f9e65088f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:51.901764 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:51.969240 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 105/219] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:24:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 15:24:51.984420 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 115/220] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 15:24:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 602 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 15:24:51.991497 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda659d7-4a87-4a35-94e4-2f9e65088f09 None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:52.032473 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c23a0e-4c08-4714-8382-7cacab68da04 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:52.188417 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:52.194013 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda659d7-4a87-4a35-94e4-2f9e65088f09 None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:52.247109 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c23a0e-4c08-4714-8382-7cacab68da04 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:52.276649 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2df9bd-9e90-435f-87e5-098ff33a6eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:52.277977 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2df9bd-9e90-435f-87e5-098ff33a6eb3 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:52.278468 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2df9bd-9e90-435f-87e5-098ff33a6eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:52.278936 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2df9bd-9e90-435f-87e5-098ff33a6eb3 None admin] PATH_INFO: `/v3/projects/24c3fa325d8a41dc8ac86599b7fb5180` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:52.281903 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2df9bd-9e90-435f-87e5-098ff33a6eb3 None admin] RBAC: Authorizing `identity:get_project(project_id=24c3fa325d8a41dc8ac86599b7fb5180)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:52.285602 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2df9bd-9e90-435f-87e5-098ff33a6eb3 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:52.290034 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 106/221] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 15:24:51 2022] GET /identity/v3/projects/24c3fa325d8a41dc8ac86599b7fb5180 => generated 302 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:24:52.298296 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2df9bd-9e90-435f-87e5-098ff33a6eb3 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:52.318809 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923e4789-bb32-460a-9d7e-1b21f6d6bafb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:52.320027 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e4789-bb32-460a-9d7e-1b21f6d6bafb None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:52.320555 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e4789-bb32-460a-9d7e-1b21f6d6bafb None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:52.321055 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e4789-bb32-460a-9d7e-1b21f6d6bafb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:52.335342 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923e4789-bb32-460a-9d7e-1b21f6d6bafb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:24:52.341228 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-923e4789-bb32-460a-9d7e-1b21f6d6bafb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 15:24:52.341228 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:24:52.341228 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:24:52.341228 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:24:52.341228 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:24:52.341228 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:24:52.341228 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:24:52.341228 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:24:52.341228 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:24:52.341228 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:24:52.341228 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:24:52.341228 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:24:52.341228 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:24:52.341228 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:24:52.341228 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:24:52.341228 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:24:52.342229 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:24:52.342229 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:24:52.342229 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:24:52.342229 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:24:52.342229 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:24:52.342229 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:24:52.342229 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:24:52.342229 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:24:52.342229 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:24:52.342229 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:24:52.342229 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:24:52.342229 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:24:52.342229 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:24:52.342229 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:24:52.342229 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:24:52.342229 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:24:52.343063 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:24:52.343063 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:24:52.343063 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:24:52.343063 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:24:52.343063 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:24:52.343063 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:24:52.343063 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:24:52.343063 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:24:52.343063 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:24:52.343063 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:24:52.343063 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 15:24:52.343063 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:24:52.346125 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 116/222] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jul 26 15:24:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 15:24:52.352510 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923e4789-bb32-460a-9d7e-1b21f6d6bafb None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:52.389068 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:52.479576 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923e4789-bb32-460a-9d7e-1b21f6d6bafb None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:52.527958 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:52.535357 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea230b6-5373-4802-ac62-b53459f9b39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:52.536117 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea230b6-5373-4802-ac62-b53459f9b39e None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:52.536474 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea230b6-5373-4802-ac62-b53459f9b39e None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:52.536740 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea230b6-5373-4802-ac62-b53459f9b39e None admin] PATH_INFO: `/v3/roles` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:52.537748 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea230b6-5373-4802-ac62-b53459f9b39e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:24:52.538064 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea230b6-5373-4802-ac62-b53459f9b39e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:52.539858 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea230b6-5373-4802-ac62-b53459f9b39e None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:52.561429 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 117/223] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 15:24:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:24:52.567825 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea230b6-5373-4802-ac62-b53459f9b39e None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:52.630905 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2df9bd-9e90-435f-87e5-098ff33a6eb3 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:52.698286 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea230b6-5373-4802-ac62-b53459f9b39e None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:52.715121 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d01e66e-85e9-4ec4-b317-ded3ff708f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:52.716186 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d01e66e-85e9-4ec4-b317-ded3ff708f32 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:52.716713 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d01e66e-85e9-4ec4-b317-ded3ff708f32 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:52.717179 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d01e66e-85e9-4ec4-b317-ded3ff708f32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:52.719393 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d01e66e-85e9-4ec4-b317-ded3ff708f32 None admin] RBAC: Adding query filter params (role.id=fd8f80bccab248edbb1d09ec187a8113, scope.project.id=24c3fa325d8a41dc8ac86599b7fb5180, user.id=9e0e095c863d436fa8ff95625f8a10f2) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:24:52.719938 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d01e66e-85e9-4ec4-b317-ded3ff708f32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:52.722701 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d01e66e-85e9-4ec4-b317-ded3ff708f32 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:52.734541 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 107/224] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 26 15:24:52 2022] GET /identity/v3/role_assignments?user.id=9e0e095c863d436fa8ff95625f8a10f2&scope.project.id=24c3fa325d8a41dc8ac86599b7fb5180&role.id=fd8f80bccab248edbb1d09ec187a8113 => generated 259 bytes in 437 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:24:52.736674 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cbd479-cebb-42ab-a5b7-004b18760776 None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:52.737216 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cbd479-cebb-42ab-a5b7-004b18760776 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:52.737689 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cbd479-cebb-42ab-a5b7-004b18760776 None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:52.740318 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 108/225] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:24:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:24:52.749565 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649f224b-0b60-421c-a153-b3afc6793c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:52.750024 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00729e-df9c-48bc-aca7-0ad55de352de None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:52.750297 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f224b-0b60-421c-a153-b3afc6793c80 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:52.750447 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00729e-df9c-48bc-aca7-0ad55de352de None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:52.750578 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f224b-0b60-421c-a153-b3afc6793c80 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:52.750858 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f224b-0b60-421c-a153-b3afc6793c80 None admin] PATH_INFO: `/v3/users/13bac95ef0094f938a977f6819031f7e` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:52.751102 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00729e-df9c-48bc-aca7-0ad55de352de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:52.756107 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649f224b-0b60-421c-a153-b3afc6793c80 None admin] RBAC: Authorizing `identity:get_user(user_id=13bac95ef0094f938a977f6819031f7e)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:52.757657 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649f224b-0b60-421c-a153-b3afc6793c80 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:52.759802 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 118/226] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 26 15:24:52 2022] GET /identity/v3/users/13bac95ef0094f938a977f6819031f7e => generated 283 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:24:52.766036 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649f224b-0b60-421c-a153-b3afc6793c80 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:52.782648 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-6e00729e-df9c-48bc-aca7-0ad55de352de None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:24:52.784848 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-6e00729e-df9c-48bc-aca7-0ad55de352de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:52.901403 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:52.933769 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 109/227] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:24:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 15:24:52.977702 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e00729e-df9c-48bc-aca7-0ad55de352de None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:53.017072 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:53.076157 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649f224b-0b60-421c-a153-b3afc6793c80 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:53.173121 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e00729e-df9c-48bc-aca7-0ad55de352de None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:53.221308 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680da6aa-2418-48c0-a66d-0180e893672c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:53.222421 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680da6aa-2418-48c0-a66d-0180e893672c None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:53.222929 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680da6aa-2418-48c0-a66d-0180e893672c None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:53.223458 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680da6aa-2418-48c0-a66d-0180e893672c None admin] PATH_INFO: `/v3/projects/24c3fa325d8a41dc8ac86599b7fb5180` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:53.225526 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680da6aa-2418-48c0-a66d-0180e893672c None admin] RBAC: Authorizing `identity:get_project(project_id=24c3fa325d8a41dc8ac86599b7fb5180)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:53.236557 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680da6aa-2418-48c0-a66d-0180e893672c None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:53.237863 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5888ae-cae6-4167-bad0-1678d5d49f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:53.238953 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5888ae-cae6-4167-bad0-1678d5d49f02 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:53.239483 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5888ae-cae6-4167-bad0-1678d5d49f02 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:53.239963 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5888ae-cae6-4167-bad0-1678d5d49f02 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:53.241130 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 119/228] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 15:24:52 2022] GET /identity/v3/projects/24c3fa325d8a41dc8ac86599b7fb5180 => generated 302 bytes in 475 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:24:53.247083 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680da6aa-2418-48c0-a66d-0180e893672c None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:53.262834 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5888ae-cae6-4167-bad0-1678d5d49f02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:24:53.276663 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application [None req-ed5888ae-cae6-4167-bad0-1678d5d49f02 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 15:24:53.276663 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:24:53.276663 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:24:53.276663 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:24:53.276663 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:24:53.276663 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:24:53.276663 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:24:53.276663 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:24:53.276663 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:24:53.276663 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:24:53.276663 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:24:53.276663 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:24:53.276663 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:24:53.276663 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:24:53.276663 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:24:53.276663 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:24:53.277806 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:24:53.277806 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:24:53.277806 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:24:53.277806 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:24:53.277806 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:24:53.277806 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:24:53.277806 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:24:53.277806 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:24:53.277806 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:24:53.277806 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:24:53.277806 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:24:53.277806 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application with Lock( Jul 26 15:24:53.277806 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:24:53.277806 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:24:53.277806 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:24:53.277806 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:24:53.279596 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:24:53.279596 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:24:53.279596 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:24:53.279596 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:24:53.279596 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:24:53.279596 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:24:53.279596 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:24:53.279596 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:24:53.279596 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:24:53.279596 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:24:53.279596 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 15:24:53.279596 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:24:53.279596 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 110/229] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jul 26 15:24:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:24:53.292791 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5888ae-cae6-4167-bad0-1678d5d49f02 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:53.425676 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680da6aa-2418-48c0-a66d-0180e893672c None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:53.449734 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:53.469311 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22325557-581e-458a-9e0d-d15fab712388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:53.471728 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22325557-581e-458a-9e0d-d15fab712388 None admin] REQUEST_METHOD: `PUT` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:53.472605 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22325557-581e-458a-9e0d-d15fab712388 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:53.474569 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22325557-581e-458a-9e0d-d15fab712388 None admin] PATH_INFO: `/v3/projects/24c3fa325d8a41dc8ac86599b7fb5180/users/13bac95ef0094f938a977f6819031f7e/roles/c86cdde38565431ebacf53dcfc4d863b` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:53.483596 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22325557-581e-458a-9e0d-d15fab712388 None admin] RBAC: Authorizing `identity:create_grant(project_id=24c3fa325d8a41dc8ac86599b7fb5180, user_id=13bac95ef0094f938a977f6819031f7e, role_id=c86cdde38565431ebacf53dcfc4d863b)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:53.484240 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22325557-581e-458a-9e0d-d15fab712388 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:53.501864 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:53.528938 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5888ae-cae6-4167-bad0-1678d5d49f02 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:53.568785 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfc7853-838c-46cb-9a19-8bf18ce0b1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:53.569842 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfc7853-838c-46cb-9a19-8bf18ce0b1ec None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:53.570354 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfc7853-838c-46cb-9a19-8bf18ce0b1ec None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:53.570831 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfc7853-838c-46cb-9a19-8bf18ce0b1ec None admin] PATH_INFO: `/v3/roles` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:53.571804 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfc7853-838c-46cb-9a19-8bf18ce0b1ec None admin] RBAC: Adding query filter params (name=admin) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:24:53.572341 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfc7853-838c-46cb-9a19-8bf18ce0b1ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:53.574034 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfc7853-838c-46cb-9a19-8bf18ce0b1ec None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:53.585072 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 111/230] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 15:24:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:24:53.593899 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfc7853-838c-46cb-9a19-8bf18ce0b1ec None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:53.613091 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 120/231] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jul 26 15:24:53 2022] PUT /identity/v3/projects/24c3fa325d8a41dc8ac86599b7fb5180/users/13bac95ef0094f938a977f6819031f7e/roles/c86cdde38565431ebacf53dcfc4d863b => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:24:53.869307 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfc7853-838c-46cb-9a19-8bf18ce0b1ec None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:53.914134 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62828e2a-73ab-49b3-878a-c75f86d0ea7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:53.914802 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62828e2a-73ab-49b3-878a-c75f86d0ea7f None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:53.915082 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62828e2a-73ab-49b3-878a-c75f86d0ea7f None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:53.915393 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62828e2a-73ab-49b3-878a-c75f86d0ea7f None admin] PATH_INFO: `/v3/users/13bac95ef0094f938a977f6819031f7e` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:53.916660 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62828e2a-73ab-49b3-878a-c75f86d0ea7f None admin] RBAC: Authorizing `identity:get_user(user_id=13bac95ef0094f938a977f6819031f7e)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:53.918147 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62828e2a-73ab-49b3-878a-c75f86d0ea7f None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:53.920144 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 112/232] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 26 15:24:53 2022] GET /identity/v3/users/13bac95ef0094f938a977f6819031f7e => generated 283 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:24:53.926474 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22325557-581e-458a-9e0d-d15fab712388 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:54.067674 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22325557-581e-458a-9e0d-d15fab712388 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:54.121467 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7092e9-942d-41b0-853e-0643304061d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:54.122056 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7092e9-942d-41b0-853e-0643304061d2 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:54.122340 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7092e9-942d-41b0-853e-0643304061d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:54.122616 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7092e9-942d-41b0-853e-0643304061d2 None admin] PATH_INFO: `/v3/projects/24c3fa325d8a41dc8ac86599b7fb5180` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:54.124401 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7092e9-942d-41b0-853e-0643304061d2 None admin] RBAC: Authorizing `identity:get_project(project_id=24c3fa325d8a41dc8ac86599b7fb5180)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:54.125891 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7092e9-942d-41b0-853e-0643304061d2 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:54.127619 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 121/233] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 15:24:53 2022] GET /identity/v3/projects/24c3fa325d8a41dc8ac86599b7fb5180 => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:24:54.133621 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62828e2a-73ab-49b3-878a-c75f86d0ea7f None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:54.147164 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:54.280988 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62828e2a-73ab-49b3-878a-c75f86d0ea7f None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:54.321504 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b40c53-78a5-4da6-82ca-d941fe94f87f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:54.322221 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b40c53-78a5-4da6-82ca-d941fe94f87f None admin] REQUEST_METHOD: `PUT` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:54.322506 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b40c53-78a5-4da6-82ca-d941fe94f87f None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:54.322792 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b40c53-78a5-4da6-82ca-d941fe94f87f None admin] PATH_INFO: `/v3/projects/24c3fa325d8a41dc8ac86599b7fb5180/users/13bac95ef0094f938a977f6819031f7e/roles/2c659645e15c4204b1457556939397cb` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:54.325116 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b40c53-78a5-4da6-82ca-d941fe94f87f None admin] RBAC: Authorizing `identity:create_grant(project_id=24c3fa325d8a41dc8ac86599b7fb5180, user_id=13bac95ef0094f938a977f6819031f7e, role_id=2c659645e15c4204b1457556939397cb)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:54.326682 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b40c53-78a5-4da6-82ca-d941fe94f87f None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:54.431883 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 113/234] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jul 26 15:24:54 2022] PUT /identity/v3/projects/24c3fa325d8a41dc8ac86599b7fb5180/users/13bac95ef0094f938a977f6819031f7e/roles/2c659645e15c4204b1457556939397cb => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:24:55.100081 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ec1ec-8b6f-43e5-8893-9afd51b72e93 None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:55.100081 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ec1ec-8b6f-43e5-8893-9afd51b72e93 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:55.100081 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ec1ec-8b6f-43e5-8893-9afd51b72e93 None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:55.101188 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 122/235] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:24:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:24:55.108759 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0166501a-7f2e-43ad-ba5e-89f6a27615ec None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:55.109234 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0166501a-7f2e-43ad-ba5e-89f6a27615ec None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:55.115061 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0166501a-7f2e-43ad-ba5e-89f6a27615ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:55.136324 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-0166501a-7f2e-43ad-ba5e-89f6a27615ec None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:24:55.139013 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-0166501a-7f2e-43ad-ba5e-89f6a27615ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:55.208186 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:55.213707 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 114/236] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:24:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:24:55.280516 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4ec1ec-8b6f-43e5-8893-9afd51b72e93 None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:55.353093 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:55.415205 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4ec1ec-8b6f-43e5-8893-9afd51b72e93 None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:55.461737 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438ddd57-5228-4a31-ac01-7ec622ad5f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:55.462737 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438ddd57-5228-4a31-ac01-7ec622ad5f4d None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:55.463242 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438ddd57-5228-4a31-ac01-7ec622ad5f4d None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:55.463722 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438ddd57-5228-4a31-ac01-7ec622ad5f4d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:55.478343 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ace07-f3bd-4c05-89eb-ccc09520f0bb None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:55.478719 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ace07-f3bd-4c05-89eb-ccc09520f0bb None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:55.479070 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ace07-f3bd-4c05-89eb-ccc09520f0bb None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:55.480771 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 115/237] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:24:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 15:24:55.482560 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438ddd57-5228-4a31-ac01-7ec622ad5f4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:24:55.488759 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-438ddd57-5228-4a31-ac01-7ec622ad5f4d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 15:24:55.488759 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:24:55.488759 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:24:55.488759 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:24:55.488759 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:24:55.488759 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:24:55.488759 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:24:55.488759 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:24:55.488759 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:24:55.488759 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:24:55.488759 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:24:55.488759 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:24:55.488759 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:24:55.488759 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:24:55.488759 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:24:55.488759 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:24:55.489716 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:24:55.489716 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:24:55.489716 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:24:55.489716 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:24:55.489716 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:24:55.489716 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:24:55.489716 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:24:55.489716 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:24:55.489716 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:24:55.489716 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:24:55.489716 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:24:55.489716 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:24:55.489716 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:24:55.489716 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:24:55.489716 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:24:55.489716 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:24:55.490522 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:24:55.490522 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:24:55.490522 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:24:55.490522 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:24:55.490522 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:24:55.490522 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:24:55.490522 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:24:55.490522 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:24:55.490522 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:24:55.490522 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:24:55.490522 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 15:24:55.490522 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:24:55.491156 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e3ad01-565f-425d-9d64-3d2aeec68ad9 None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:55.491156 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e3ad01-565f-425d-9d64-3d2aeec68ad9 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:55.491156 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e3ad01-565f-425d-9d64-3d2aeec68ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:55.492859 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 123/238] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 15:24:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:24:55.504218 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438ddd57-5228-4a31-ac01-7ec622ad5f4d None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:55.523170 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-e9e3ad01-565f-425d-9d64-3d2aeec68ad9 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:24:55.523170 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-e9e3ad01-565f-425d-9d64-3d2aeec68ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:55.659144 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 116/239] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:24:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 15:24:55.691029 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e3ad01-565f-425d-9d64-3d2aeec68ad9 None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:55.716569 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438ddd57-5228-4a31-ac01-7ec622ad5f4d None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:55.758246 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:55.824262 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80825592-b59d-4d84-902e-a90cf6b1112f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:55.825370 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80825592-b59d-4d84-902e-a90cf6b1112f None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:55.825882 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80825592-b59d-4d84-902e-a90cf6b1112f None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:55.826378 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80825592-b59d-4d84-902e-a90cf6b1112f None admin] PATH_INFO: `/v3/roles` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:55.828171 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80825592-b59d-4d84-902e-a90cf6b1112f None admin] RBAC: Adding query filter params (name=reader) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:24:55.828662 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80825592-b59d-4d84-902e-a90cf6b1112f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:55.831118 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80825592-b59d-4d84-902e-a90cf6b1112f None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:55.858518 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 124/240] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jul 26 15:24:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:24:55.866996 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80825592-b59d-4d84-902e-a90cf6b1112f None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:55.962712 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e3ad01-565f-425d-9d64-3d2aeec68ad9 None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:55.993212 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80825592-b59d-4d84-902e-a90cf6b1112f None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:56.032041 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b785a0-7ed0-4964-85da-3a56b7bb6fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:56.032979 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b785a0-7ed0-4964-85da-3a56b7bb6fd2 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:56.033419 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b785a0-7ed0-4964-85da-3a56b7bb6fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:56.033845 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b785a0-7ed0-4964-85da-3a56b7bb6fd2 None admin] PATH_INFO: `/v3/users/4a25bedd21164ed0a20dd7c4835e5305` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:56.047781 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:56.051479 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b785a0-7ed0-4964-85da-3a56b7bb6fd2 None admin] RBAC: Authorizing `identity:get_user(user_id=4a25bedd21164ed0a20dd7c4835e5305)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:56.053261 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b785a0-7ed0-4964-85da-3a56b7bb6fd2 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:56.055221 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 125/241] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 26 15:24:55 2022] GET /identity/v3/users/4a25bedd21164ed0a20dd7c4835e5305 => generated 297 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:24:56.067911 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b785a0-7ed0-4964-85da-3a56b7bb6fd2 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:56.074327 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719daa4c-f97c-4191-aefb-d054f60723e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:56.076134 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719daa4c-f97c-4191-aefb-d054f60723e7 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:56.076134 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719daa4c-f97c-4191-aefb-d054f60723e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:56.076498 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719daa4c-f97c-4191-aefb-d054f60723e7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:56.087199 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719daa4c-f97c-4191-aefb-d054f60723e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:56.087437 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719daa4c-f97c-4191-aefb-d054f60723e7 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:56.095379 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 117/242] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 15:24:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 400 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:24:56.111049 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719daa4c-f97c-4191-aefb-d054f60723e7 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:56.139332 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:56.345427 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b785a0-7ed0-4964-85da-3a56b7bb6fd2 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:56.394885 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccee0ef-ba6f-483c-848a-d722f6563bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:56.395936 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccee0ef-ba6f-483c-848a-d722f6563bda None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:56.401573 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccee0ef-ba6f-483c-848a-d722f6563bda None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:56.402160 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccee0ef-ba6f-483c-848a-d722f6563bda None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:56.466115 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719daa4c-f97c-4191-aefb-d054f60723e7 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:56.537432 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccee0ef-ba6f-483c-848a-d722f6563bda None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:56.539655 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccee0ef-ba6f-483c-848a-d722f6563bda None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:56.575993 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:56.587914 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab69db89-eebf-4b65-8d5b-94103472b706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:56.588606 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab69db89-eebf-4b65-8d5b-94103472b706 None admin] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:56.588914 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab69db89-eebf-4b65-8d5b-94103472b706 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:56.589192 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab69db89-eebf-4b65-8d5b-94103472b706 None admin] PATH_INFO: `/v3/users` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:56.589901 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab69db89-eebf-4b65-8d5b-94103472b706 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:56.591492 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab69db89-eebf-4b65-8d5b-94103472b706 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:56.669767 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 126/243] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 15:24:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 602 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 15:24:56.671680 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1a2fcb-b5cf-4ce2-b68e-79e4999fdec7 None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:56.672258 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1a2fcb-b5cf-4ce2-b68e-79e4999fdec7 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:56.672783 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1a2fcb-b5cf-4ce2-b68e-79e4999fdec7 None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:56.674675 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 127/244] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:24:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:24:56.679037 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1a2fcb-b5cf-4ce2-b68e-79e4999fdec7 None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:56.697415 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 118/245] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Jul 26 15:24:56 2022] POST /identity/v3/users => generated 293 bytes in 587 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:24:56.700224 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ff35ab-2fa2-4ec5-9ffd-e56e302e84e8 None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:56.700831 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ff35ab-2fa2-4ec5-9ffd-e56e302e84e8 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:56.701347 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ff35ab-2fa2-4ec5-9ffd-e56e302e84e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:56.746851 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-b2ff35ab-2fa2-4ec5-9ffd-e56e302e84e8 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:24:56.751420 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-b2ff35ab-2fa2-4ec5-9ffd-e56e302e84e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:56.867534 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:56.917328 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1a2fcb-b5cf-4ce2-b68e-79e4999fdec7 None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:56.941563 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 119/246] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:24:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:24:56.952069 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:56.961599 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8fb9e6-815c-4513-9d1b-bafed87b4571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:56.962501 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8fb9e6-815c-4513-9d1b-bafed87b4571 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:56.962935 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8fb9e6-815c-4513-9d1b-bafed87b4571 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:56.963840 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8fb9e6-815c-4513-9d1b-bafed87b4571 None admin] PATH_INFO: `/v3/projects/24c3fa325d8a41dc8ac86599b7fb5180` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:56.964948 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8fb9e6-815c-4513-9d1b-bafed87b4571 None admin] RBAC: Authorizing `identity:get_project(project_id=24c3fa325d8a41dc8ac86599b7fb5180)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:56.966680 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8fb9e6-815c-4513-9d1b-bafed87b4571 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:56.969257 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 128/247] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 15:24:56 2022] GET /identity/v3/projects/24c3fa325d8a41dc8ac86599b7fb5180 => generated 302 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:24:56.978665 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ff35ab-2fa2-4ec5-9ffd-e56e302e84e8 None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:56.996693 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8fb9e6-815c-4513-9d1b-bafed87b4571 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:57.106030 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ff35ab-2fa2-4ec5-9ffd-e56e302e84e8 None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:57.147067 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3cae5f-1684-418f-9a8d-6b16f3fc7106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:57.148620 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3cae5f-1684-418f-9a8d-6b16f3fc7106 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:57.149089 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3cae5f-1684-418f-9a8d-6b16f3fc7106 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:57.149612 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3cae5f-1684-418f-9a8d-6b16f3fc7106 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:57.150741 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3cae5f-1684-418f-9a8d-6b16f3fc7106 None admin] RBAC: Adding query filter params (role.id=c692edefa26c417c8d43da5d89ec8462, scope.project.id=24c3fa325d8a41dc8ac86599b7fb5180, user.id=4a25bedd21164ed0a20dd7c4835e5305) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:24:57.151477 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3cae5f-1684-418f-9a8d-6b16f3fc7106 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:57.153326 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3cae5f-1684-418f-9a8d-6b16f3fc7106 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:57.160537 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 120/248] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 26 15:24:56 2022] GET /identity/v3/role_assignments?user.id=4a25bedd21164ed0a20dd7c4835e5305&scope.project.id=24c3fa325d8a41dc8ac86599b7fb5180&role.id=c692edefa26c417c8d43da5d89ec8462 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:24:57.226471 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8fb9e6-815c-4513-9d1b-bafed87b4571 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:57.309757 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc192128-726e-4881-9221-81e9116d6a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:57.310884 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc192128-726e-4881-9221-81e9116d6a3a None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:57.311461 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc192128-726e-4881-9221-81e9116d6a3a None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:57.311956 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc192128-726e-4881-9221-81e9116d6a3a None admin] PATH_INFO: `/v3/roles/member` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:57.338781 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc192128-726e-4881-9221-81e9116d6a3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:24:57.349486 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-fc192128-726e-4881-9221-81e9116d6a3a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 15:24:57.349486 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:24:57.349486 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:24:57.349486 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:24:57.349486 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:24:57.349486 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:24:57.349486 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:24:57.349486 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:24:57.349486 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:24:57.349486 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:24:57.349486 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:24:57.349486 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:24:57.349486 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:24:57.349486 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:24:57.349486 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:24:57.349486 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:24:57.350813 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:24:57.350813 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:24:57.350813 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:24:57.350813 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:24:57.350813 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:24:57.350813 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:24:57.350813 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:24:57.350813 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:24:57.350813 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:24:57.350813 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:24:57.350813 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:24:57.350813 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:24:57.350813 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:24:57.350813 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:24:57.350813 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:24:57.350813 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:24:57.351736 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:24:57.351736 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:24:57.351736 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:24:57.351736 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:24:57.351736 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:24:57.351736 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:24:57.351736 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:24:57.351736 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:24:57.351736 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:24:57.351736 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:24:57.351736 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 15:24:57.351736 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:24:57.353510 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 129/249] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 15:24:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 15:24:57.358383 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3cae5f-1684-418f-9a8d-6b16f3fc7106 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:57.467583 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:57.581778 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3cae5f-1684-418f-9a8d-6b16f3fc7106 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:57.612205 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac9460f-71b3-44fe-9142-009c753b67d1 None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:57.612706 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac9460f-71b3-44fe-9142-009c753b67d1 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:57.613198 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac9460f-71b3-44fe-9142-009c753b67d1 None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:57.622408 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 130/250] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:24:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:24:57.629557 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9963224e-134a-4072-a768-36bfbd681a12 None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:57.630056 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9963224e-134a-4072-a768-36bfbd681a12 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:57.630546 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9963224e-134a-4072-a768-36bfbd681a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:57.664385 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc104d9-49fc-4dfd-834c-98f04ad9517a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:57.665459 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc104d9-49fc-4dfd-834c-98f04ad9517a None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:57.665964 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc104d9-49fc-4dfd-834c-98f04ad9517a None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:57.666669 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc104d9-49fc-4dfd-834c-98f04ad9517a None admin] PATH_INFO: `/v3/roles` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:57.668062 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc104d9-49fc-4dfd-834c-98f04ad9517a None admin] RBAC: Adding query filter params (name=member) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:24:57.668582 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc104d9-49fc-4dfd-834c-98f04ad9517a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:57.675695 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc104d9-49fc-4dfd-834c-98f04ad9517a None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:57.690518 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-9963224e-134a-4072-a768-36bfbd681a12 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:24:57.691061 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 121/251] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jul 26 15:24:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:24:57.692024 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7460acee-d967-45fb-96c6-44c2b3aab551 None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:57.692315 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7460acee-d967-45fb-96c6-44c2b3aab551 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:57.692591 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7460acee-d967-45fb-96c6-44c2b3aab551 None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:57.692754 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-9963224e-134a-4072-a768-36bfbd681a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:57.694083 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 122/252] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:24:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:24:57.699572 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7460acee-d967-45fb-96c6-44c2b3aab551 None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:57.838602 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:57.866640 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 131/253] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:24:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 15:24:57.867781 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd7871-5fd3-4168-a996-3a26b7f7d5c7 None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:57.868076 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd7871-5fd3-4168-a996-3a26b7f7d5c7 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:57.868364 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd7871-5fd3-4168-a996-3a26b7f7d5c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:57.887987 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-30dd7871-5fd3-4168-a996-3a26b7f7d5c7 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:24:57.889762 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-30dd7871-5fd3-4168-a996-3a26b7f7d5c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:58.029579 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7460acee-d967-45fb-96c6-44c2b3aab551 None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:58.033529 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 132/254] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:24:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:24:58.035069 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dd7871-5fd3-4168-a996-3a26b7f7d5c7 None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:58.070679 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:58.146231 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d3785b-a8a8-494a-aca0-9efd9f01fc62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:58.152224 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3785b-a8a8-494a-aca0-9efd9f01fc62 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:58.152844 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3785b-a8a8-494a-aca0-9efd9f01fc62 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:58.153317 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3785b-a8a8-494a-aca0-9efd9f01fc62 None admin] PATH_INFO: `/v3/users/9e0e095c863d436fa8ff95625f8a10f2` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:58.156643 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d3785b-a8a8-494a-aca0-9efd9f01fc62 None admin] RBAC: Authorizing `identity:get_user(user_id=9e0e095c863d436fa8ff95625f8a10f2)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:58.159588 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d3785b-a8a8-494a-aca0-9efd9f01fc62 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:58.174164 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 123/255] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 26 15:24:57 2022] GET /identity/v3/users/9e0e095c863d436fa8ff95625f8a10f2 => generated 297 bytes in 475 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:24:58.175808 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d3785b-a8a8-494a-aca0-9efd9f01fc62 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:58.352067 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dd7871-5fd3-4168-a996-3a26b7f7d5c7 None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:58.411874 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:58.487596 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d3785b-a8a8-494a-aca0-9efd9f01fc62 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:58.503089 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d11902-e8af-4d86-85a3-08e6ff271d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:58.504141 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d11902-e8af-4d86-85a3-08e6ff271d8c None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:58.504624 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d11902-e8af-4d86-85a3-08e6ff271d8c None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:58.505095 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d11902-e8af-4d86-85a3-08e6ff271d8c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:58.555931 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d11902-e8af-4d86-85a3-08e6ff271d8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:24:58.573449 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-38d11902-e8af-4d86-85a3-08e6ff271d8c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 15:24:58.573449 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:24:58.573449 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:24:58.573449 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:24:58.573449 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:24:58.573449 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:24:58.573449 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:24:58.573449 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:24:58.573449 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:24:58.573449 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:24:58.573449 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:24:58.573449 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:24:58.573449 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:24:58.573449 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:24:58.573449 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:24:58.573449 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:24:58.574381 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:24:58.574381 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:24:58.574381 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:24:58.574381 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:24:58.574381 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:24:58.574381 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:24:58.574381 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:24:58.574381 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:24:58.574381 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:24:58.574381 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:24:58.574381 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:24:58.574381 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:24:58.574381 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:24:58.574381 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:24:58.574381 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:24:58.574381 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:24:58.575185 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:24:58.575185 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:24:58.575185 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:24:58.575185 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:24:58.575185 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:24:58.575185 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:24:58.575185 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:24:58.575185 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:24:58.575185 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:24:58.575185 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:24:58.575185 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 15:24:58.575185 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:24:58.581463 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 133/256] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jul 26 15:24:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 547 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:24:58.582990 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d11902-e8af-4d86-85a3-08e6ff271d8c None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:58.584791 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59a5845-f48c-423b-aeaa-31ea8786a383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:58.585938 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59a5845-f48c-423b-aeaa-31ea8786a383 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:58.586471 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59a5845-f48c-423b-aeaa-31ea8786a383 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:58.586977 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59a5845-f48c-423b-aeaa-31ea8786a383 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:58.622295 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59a5845-f48c-423b-aeaa-31ea8786a383 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:24:58.627700 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application [None req-e59a5845-f48c-423b-aeaa-31ea8786a383 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 15:24:58.627700 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:24:58.627700 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:24:58.627700 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:24:58.627700 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:24:58.627700 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:24:58.627700 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:24:58.627700 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:24:58.627700 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:24:58.627700 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:24:58.627700 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:24:58.627700 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:24:58.627700 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:24:58.627700 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:24:58.627700 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:24:58.627700 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:24:58.628624 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:24:58.628624 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:24:58.628624 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:24:58.628624 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:24:58.628624 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:24:58.628624 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:24:58.628624 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:24:58.628624 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:24:58.628624 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:24:58.628624 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:24:58.628624 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:24:58.628624 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application with Lock( Jul 26 15:24:58.628624 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:24:58.628624 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:24:58.628624 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:24:58.628624 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:24:58.629472 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:24:58.629472 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:24:58.629472 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:24:58.629472 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:24:58.629472 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:24:58.629472 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:24:58.629472 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:24:58.629472 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:24:58.629472 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:24:58.629472 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:24:58.629472 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 15:24:58.629472 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:24:58.629472 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 124/257] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jul 26 15:24:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 454 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:24:58.630098 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59a5845-f48c-423b-aeaa-31ea8786a383 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:58.719314 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:58.772533 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d11902-e8af-4d86-85a3-08e6ff271d8c None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:58.816757 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45baebe-0591-40de-9fac-4f176d5b13c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:58.817421 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45baebe-0591-40de-9fac-4f176d5b13c6 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:58.817701 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45baebe-0591-40de-9fac-4f176d5b13c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:58.817972 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45baebe-0591-40de-9fac-4f176d5b13c6 None admin] PATH_INFO: `/v3/projects/24c3fa325d8a41dc8ac86599b7fb5180` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:58.820367 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45baebe-0591-40de-9fac-4f176d5b13c6 None admin] RBAC: Authorizing `identity:get_project(project_id=24c3fa325d8a41dc8ac86599b7fb5180)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:58.821866 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45baebe-0591-40de-9fac-4f176d5b13c6 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:58.827688 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 134/258] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 15:24:58 2022] GET /identity/v3/projects/24c3fa325d8a41dc8ac86599b7fb5180 => generated 302 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:24:58.828753 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45baebe-0591-40de-9fac-4f176d5b13c6 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:58.885224 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:58.963218 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59a5845-f48c-423b-aeaa-31ea8786a383 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:59.002025 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45baebe-0591-40de-9fac-4f176d5b13c6 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:59.033209 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a504c692-76bc-43bb-84c6-e3b679403f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:59.033878 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a504c692-76bc-43bb-84c6-e3b679403f89 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:59.034159 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a504c692-76bc-43bb-84c6-e3b679403f89 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:59.034453 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a504c692-76bc-43bb-84c6-e3b679403f89 None admin] PATH_INFO: `/v3/roles` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:59.036109 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a504c692-76bc-43bb-84c6-e3b679403f89 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:24:59.036435 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a504c692-76bc-43bb-84c6-e3b679403f89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:59.039943 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a504c692-76bc-43bb-84c6-e3b679403f89 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:59.061163 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 125/259] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 15:24:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 431 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:24:59.061839 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a504c692-76bc-43bb-84c6-e3b679403f89 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:59.094650 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6c1d60-ffab-4e50-b018-d6b867eba7fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:59.095340 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6c1d60-ffab-4e50-b018-d6b867eba7fe None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:59.095609 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6c1d60-ffab-4e50-b018-d6b867eba7fe None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:59.095880 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6c1d60-ffab-4e50-b018-d6b867eba7fe None admin] PATH_INFO: `/v3/roles` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:59.096625 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6c1d60-ffab-4e50-b018-d6b867eba7fe None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:24:59.096932 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6c1d60-ffab-4e50-b018-d6b867eba7fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:59.098478 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6c1d60-ffab-4e50-b018-d6b867eba7fe None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:59.120845 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 135/260] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 15:24:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:24:59.121883 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6c1d60-ffab-4e50-b018-d6b867eba7fe None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:59.227742 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:59.245260 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a504c692-76bc-43bb-84c6-e3b679403f89 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:59.282427 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6c1d60-ffab-4e50-b018-d6b867eba7fe None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:59.292319 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:59.331766 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be832e88-b841-45e7-a021-ef6832e5485b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:59.333028 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be832e88-b841-45e7-a021-ef6832e5485b None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:59.334111 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be832e88-b841-45e7-a021-ef6832e5485b None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:59.335560 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be832e88-b841-45e7-a021-ef6832e5485b None admin] PATH_INFO: `/v3/users/13bac95ef0094f938a977f6819031f7e` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:59.338031 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be832e88-b841-45e7-a021-ef6832e5485b None admin] RBAC: Authorizing `identity:get_user(user_id=13bac95ef0094f938a977f6819031f7e)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:59.340177 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be832e88-b841-45e7-a021-ef6832e5485b None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:59.341706 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6cce4c-7d9d-442e-bc56-b00e2c651818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:59.343280 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6cce4c-7d9d-442e-bc56-b00e2c651818 None admin] REQUEST_METHOD: `PUT` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:59.345325 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 136/261] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 26 15:24:59 2022] GET /identity/v3/users/13bac95ef0094f938a977f6819031f7e => generated 283 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:24:59.345874 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6cce4c-7d9d-442e-bc56-b00e2c651818 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:59.346343 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6cce4c-7d9d-442e-bc56-b00e2c651818 None admin] PATH_INFO: `/v3/projects/24c3fa325d8a41dc8ac86599b7fb5180/users/9e0e095c863d436fa8ff95625f8a10f2/roles/fd8f80bccab248edbb1d09ec187a8113` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:59.348415 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be832e88-b841-45e7-a021-ef6832e5485b None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:59.350399 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6cce4c-7d9d-442e-bc56-b00e2c651818 None admin] RBAC: Authorizing `identity:create_grant(project_id=24c3fa325d8a41dc8ac86599b7fb5180, user_id=9e0e095c863d436fa8ff95625f8a10f2, role_id=fd8f80bccab248edbb1d09ec187a8113)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:59.354666 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6cce4c-7d9d-442e-bc56-b00e2c651818 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:59.463785 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 126/262] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jul 26 15:24:59 2022] PUT /identity/v3/projects/24c3fa325d8a41dc8ac86599b7fb5180/users/9e0e095c863d436fa8ff95625f8a10f2/roles/fd8f80bccab248edbb1d09ec187a8113 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:24:59.464421 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6cce4c-7d9d-442e-bc56-b00e2c651818 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:59.473536 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be832e88-b841-45e7-a021-ef6832e5485b None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:59.517807 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2601b7cc-5ef0-4474-9646-81fc4e66ca7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:59.518829 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2601b7cc-5ef0-4474-9646-81fc4e66ca7b None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:59.519399 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2601b7cc-5ef0-4474-9646-81fc4e66ca7b None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:59.519862 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2601b7cc-5ef0-4474-9646-81fc4e66ca7b None admin] PATH_INFO: `/v3/users/13bac95ef0094f938a977f6819031f7e` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:59.522155 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2601b7cc-5ef0-4474-9646-81fc4e66ca7b None admin] RBAC: Authorizing `identity:get_user(user_id=13bac95ef0094f938a977f6819031f7e)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:59.524150 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2601b7cc-5ef0-4474-9646-81fc4e66ca7b None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:59.526863 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 137/263] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 26 15:24:59 2022] GET /identity/v3/users/13bac95ef0094f938a977f6819031f7e => generated 283 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:24:59.535049 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2601b7cc-5ef0-4474-9646-81fc4e66ca7b None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:59.625836 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:59.706905 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2601b7cc-5ef0-4474-9646-81fc4e66ca7b None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:59.769062 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3398a104-ac5b-4238-bb29-8ee788ba6bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:59.770024 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3398a104-ac5b-4238-bb29-8ee788ba6bce None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:59.770494 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3398a104-ac5b-4238-bb29-8ee788ba6bce None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:59.770951 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3398a104-ac5b-4238-bb29-8ee788ba6bce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:59.841669 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6cce4c-7d9d-442e-bc56-b00e2c651818 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:59.863803 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3398a104-ac5b-4238-bb29-8ee788ba6bce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:59.865844 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3398a104-ac5b-4238-bb29-8ee788ba6bce None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:59.910959 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b8b498-f6ff-459d-bc04-d21876221e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:59.911650 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b8b498-f6ff-459d-bc04-d21876221e14 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:59.911935 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b8b498-f6ff-459d-bc04-d21876221e14 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:59.912215 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b8b498-f6ff-459d-bc04-d21876221e14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:59.943544 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:59.984612 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:00.035730 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 138/264] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 15:24:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 26 15:25:00.048409 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3398a104-ac5b-4238-bb29-8ee788ba6bce None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:00.078429 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b8b498-f6ff-459d-bc04-d21876221e14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:00.080005 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b8b498-f6ff-459d-bc04-d21876221e14 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:00.228862 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3398a104-ac5b-4238-bb29-8ee788ba6bce None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:00.288082 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139c0a88-a7b3-4704-9e5d-6ee9c8ba8e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:00.288765 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139c0a88-a7b3-4704-9e5d-6ee9c8ba8e78 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:00.289055 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139c0a88-a7b3-4704-9e5d-6ee9c8ba8e78 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:00.289333 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139c0a88-a7b3-4704-9e5d-6ee9c8ba8e78 None admin] PATH_INFO: `/v3/projects/24c3fa325d8a41dc8ac86599b7fb5180` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:00.290609 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139c0a88-a7b3-4704-9e5d-6ee9c8ba8e78 None admin] RBAC: Authorizing `identity:get_project(project_id=24c3fa325d8a41dc8ac86599b7fb5180)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:00.292196 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139c0a88-a7b3-4704-9e5d-6ee9c8ba8e78 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:00.294680 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 139/265] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 15:25:00 2022] GET /identity/v3/projects/24c3fa325d8a41dc8ac86599b7fb5180 => generated 302 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:00.301303 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139c0a88-a7b3-4704-9e5d-6ee9c8ba8e78 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:00.324798 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:00.376326 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 127/266] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 15:24:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 911 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 15:25:00.381332 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b8b498-f6ff-459d-bc04-d21876221e14 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:00.474423 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139c0a88-a7b3-4704-9e5d-6ee9c8ba8e78 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:00.541163 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cca4a4e-1095-4b26-bd45-cf582ad7496e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:00.541733 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca4a4e-1095-4b26-bd45-cf582ad7496e None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:00.542026 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca4a4e-1095-4b26-bd45-cf582ad7496e None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:00.542311 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca4a4e-1095-4b26-bd45-cf582ad7496e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:00.543259 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cca4a4e-1095-4b26-bd45-cf582ad7496e None admin] RBAC: Adding query filter params (role.id=c86cdde38565431ebacf53dcfc4d863b, scope.project.id=24c3fa325d8a41dc8ac86599b7fb5180, user.id=13bac95ef0094f938a977f6819031f7e) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:00.543490 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cca4a4e-1095-4b26-bd45-cf582ad7496e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:00.546071 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cca4a4e-1095-4b26-bd45-cf582ad7496e None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:00.553448 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 140/267] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 26 15:25:00 2022] GET /identity/v3/role_assignments?user.id=13bac95ef0094f938a977f6819031f7e&scope.project.id=24c3fa325d8a41dc8ac86599b7fb5180&role.id=c86cdde38565431ebacf53dcfc4d863b => generated 608 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:00.575369 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:00.673055 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b8b498-f6ff-459d-bc04-d21876221e14 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:00.698918 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a0cdd-2798-4e67-8da7-6fc93abcf196 None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:00.703183 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a0cdd-2798-4e67-8da7-6fc93abcf196 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:00.703183 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a0cdd-2798-4e67-8da7-6fc93abcf196 None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:00.704017 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 141/268] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:25:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:25:00.712977 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9048779-3454-4033-adec-97164fd52e47 None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:00.713480 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9048779-3454-4033-adec-97164fd52e47 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:00.713971 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9048779-3454-4033-adec-97164fd52e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:00.742399 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6256193d-3233-4fa2-9f9d-2fa760239a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:00.743618 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6256193d-3233-4fa2-9f9d-2fa760239a32 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:00.744129 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6256193d-3233-4fa2-9f9d-2fa760239a32 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:00.744622 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6256193d-3233-4fa2-9f9d-2fa760239a32 None admin] PATH_INFO: `/v3/projects/24c3fa325d8a41dc8ac86599b7fb5180` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:00.749996 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6256193d-3233-4fa2-9f9d-2fa760239a32 None admin] RBAC: Authorizing `identity:get_project(project_id=24c3fa325d8a41dc8ac86599b7fb5180)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:00.751941 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6256193d-3233-4fa2-9f9d-2fa760239a32 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:00.754441 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 128/269] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 15:25:00 2022] GET /identity/v3/projects/24c3fa325d8a41dc8ac86599b7fb5180 => generated 302 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:00.763420 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6256193d-3233-4fa2-9f9d-2fa760239a32 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:00.773184 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-e9048779-3454-4033-adec-97164fd52e47 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:25:00.775674 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-e9048779-3454-4033-adec-97164fd52e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:25:00.913413 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6256193d-3233-4fa2-9f9d-2fa760239a32 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:00.946681 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:00.957834 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 142/270] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:25:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:25:00.967246 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f496625-8304-4ad1-ac2c-62e469f15c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:00.967246 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f496625-8304-4ad1-ac2c-62e469f15c62 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:00.967844 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf25ee-a523-4508-93b2-581e048fd5a6 None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:00.967978 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f496625-8304-4ad1-ac2c-62e469f15c62 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:00.968108 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf25ee-a523-4508-93b2-581e048fd5a6 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:00.968275 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f496625-8304-4ad1-ac2c-62e469f15c62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:00.968405 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf25ee-a523-4508-93b2-581e048fd5a6 None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:00.968533 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f496625-8304-4ad1-ac2c-62e469f15c62 None admin] RBAC: Adding query filter params (role.id=2c659645e15c4204b1457556939397cb, scope.project.id=24c3fa325d8a41dc8ac86599b7fb5180, user.id=13bac95ef0094f938a977f6819031f7e) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:00.968533 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f496625-8304-4ad1-ac2c-62e469f15c62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:00.968533 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f496625-8304-4ad1-ac2c-62e469f15c62 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:00.968902 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 143/271] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:25:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:25:00.971036 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 129/272] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 26 15:25:00 2022] GET /identity/v3/role_assignments?user.id=13bac95ef0094f938a977f6819031f7e&scope.project.id=24c3fa325d8a41dc8ac86599b7fb5180&role.id=2c659645e15c4204b1457556939397cb => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:25:00.972961 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfba2b22-546a-4ba9-b536-02eb093693f6 None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:00.973132 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30957f7-3a1f-4413-a110-f91a1ba3b5da None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:00.973256 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30957f7-3a1f-4413-a110-f91a1ba3b5da None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:00.973522 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfba2b22-546a-4ba9-b536-02eb093693f6 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:00.973693 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30957f7-3a1f-4413-a110-f91a1ba3b5da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:00.973943 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfba2b22-546a-4ba9-b536-02eb093693f6 None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:00.976593 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 144/273] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:25:00 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:25:00.986505 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebbd02e-1ca9-4219-bf05-8cb5af606750 None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:00.986505 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebbd02e-1ca9-4219-bf05-8cb5af606750 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:00.986505 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebbd02e-1ca9-4219-bf05-8cb5af606750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:00.999194 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:01.012125 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-9ebbd02e-1ca9-4219-bf05-8cb5af606750 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:25:01.013621 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-9ebbd02e-1ca9-4219-bf05-8cb5af606750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:25:01.048001 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-a30957f7-3a1f-4413-a110-f91a1ba3b5da None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:25:01.050055 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-a30957f7-3a1f-4413-a110-f91a1ba3b5da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:25:01.179189 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 145/274] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:25:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 15:25:01.181220 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebbd02e-1ca9-4219-bf05-8cb5af606750 None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:01.226260 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 130/275] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:25:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 26 15:25:01.227849 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30957f7-3a1f-4413-a110-f91a1ba3b5da None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:01.394941 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebbd02e-1ca9-4219-bf05-8cb5af606750 None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:01.430282 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30957f7-3a1f-4413-a110-f91a1ba3b5da None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:01.442401 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566890b6-65ce-4b3b-b6a1-a9d2b053e12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:01.443092 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566890b6-65ce-4b3b-b6a1-a9d2b053e12a None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:01.443433 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566890b6-65ce-4b3b-b6a1-a9d2b053e12a None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:01.443716 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566890b6-65ce-4b3b-b6a1-a9d2b053e12a None admin] PATH_INFO: `/v3/roles/member` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:01.445991 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:01.462086 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566890b6-65ce-4b3b-b6a1-a9d2b053e12a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:25:01.467385 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-566890b6-65ce-4b3b-b6a1-a9d2b053e12a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 15:25:01.467385 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:25:01.467385 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:25:01.467385 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:25:01.467385 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:25:01.467385 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:25:01.467385 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:25:01.467385 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:25:01.467385 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:25:01.467385 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:25:01.467385 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:25:01.467385 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:25:01.467385 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:25:01.467385 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:25:01.467385 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:25:01.467385 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:25:01.469367 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:25:01.469367 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:25:01.469367 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:25:01.469367 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:25:01.469367 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:25:01.469367 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:25:01.469367 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:25:01.469367 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:25:01.469367 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:25:01.469367 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:25:01.469367 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:25:01.469367 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:25:01.469367 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:25:01.469367 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:25:01.469367 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:25:01.469367 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:25:01.471168 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:25:01.471168 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:25:01.471168 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:25:01.471168 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:25:01.471168 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:25:01.471168 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:25:01.471168 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:25:01.471168 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:25:01.471168 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:25:01.471168 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:25:01.471168 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 15:25:01.471168 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:25:01.471168 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 146/276] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 15:25:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:25:01.471168 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566890b6-65ce-4b3b-b6a1-a9d2b053e12a None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:01.480306 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:01.507620 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96988e40-7d92-4580-83e2-67af98e7e7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:01.508720 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96988e40-7d92-4580-83e2-67af98e7e7e9 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:01.509221 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96988e40-7d92-4580-83e2-67af98e7e7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:01.509718 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96988e40-7d92-4580-83e2-67af98e7e7e9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:01.511987 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96988e40-7d92-4580-83e2-67af98e7e7e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:01.515527 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96988e40-7d92-4580-83e2-67af98e7e7e9 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:01.526657 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 131/277] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 15:25:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:01.526657 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96988e40-7d92-4580-83e2-67af98e7e7e9 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:01.638636 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566890b6-65ce-4b3b-b6a1-a9d2b053e12a None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:01.685349 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26005ff3-f408-4641-a23d-d200c25a0507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:01.686701 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26005ff3-f408-4641-a23d-d200c25a0507 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:01.687080 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26005ff3-f408-4641-a23d-d200c25a0507 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:01.687570 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26005ff3-f408-4641-a23d-d200c25a0507 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:01.702518 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26005ff3-f408-4641-a23d-d200c25a0507 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:25:01.706881 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96988e40-7d92-4580-83e2-67af98e7e7e9 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:01.708491 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-26005ff3-f408-4641-a23d-d200c25a0507 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 15:25:01.708491 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:25:01.708491 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:25:01.708491 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:25:01.708491 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:25:01.708491 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:25:01.708491 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:25:01.708491 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:25:01.708491 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:25:01.708491 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:25:01.708491 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:25:01.708491 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:25:01.708491 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:25:01.708491 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:25:01.708491 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:25:01.708491 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:25:01.710150 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:25:01.710150 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:25:01.710150 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:25:01.710150 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:25:01.710150 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:25:01.710150 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:25:01.710150 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:25:01.710150 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:25:01.710150 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:25:01.710150 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:25:01.710150 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:25:01.710150 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:25:01.710150 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:25:01.710150 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:25:01.710150 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:25:01.710150 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:25:01.711772 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:25:01.711772 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:25:01.711772 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:25:01.711772 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:25:01.711772 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:25:01.711772 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:25:01.711772 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:25:01.711772 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:25:01.711772 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:25:01.711772 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:25:01.711772 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 15:25:01.711772 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:25:01.711772 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 147/278] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 15:25:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:25:01.713968 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26005ff3-f408-4641-a23d-d200c25a0507 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:01.764723 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f678e5-35da-450e-8962-d449a11ea15b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:01.765398 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f678e5-35da-450e-8962-d449a11ea15b None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:01.765775 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f678e5-35da-450e-8962-d449a11ea15b None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:01.766060 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f678e5-35da-450e-8962-d449a11ea15b None admin] PATH_INFO: `/v3/roles` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:01.766803 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f678e5-35da-450e-8962-d449a11ea15b None admin] RBAC: Adding query filter params (name=member) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:01.767117 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f678e5-35da-450e-8962-d449a11ea15b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:01.768559 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f678e5-35da-450e-8962-d449a11ea15b None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:01.778656 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 132/279] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jul 26 15:25:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:01.780100 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f678e5-35da-450e-8962-d449a11ea15b None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:01.808532 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:01.872590 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:01.882621 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26005ff3-f408-4641-a23d-d200c25a0507 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:01.955532 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3c4148-8dec-49bd-9cef-b4dcfa5b99f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:01.956583 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c4148-8dec-49bd-9cef-b4dcfa5b99f3 None admin] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:01.957067 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c4148-8dec-49bd-9cef-b4dcfa5b99f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:01.957558 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c4148-8dec-49bd-9cef-b4dcfa5b99f3 None admin] PATH_INFO: `/v3/users` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:01.958812 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3c4148-8dec-49bd-9cef-b4dcfa5b99f3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:01.961407 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f678e5-35da-450e-8962-d449a11ea15b None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:01.961604 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3c4148-8dec-49bd-9cef-b4dcfa5b99f3 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:02.026381 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dec06af-b678-4cac-a789-bc538a52843f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:02.027479 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec06af-b678-4cac-a789-bc538a52843f None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:02.027955 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec06af-b678-4cac-a789-bc538a52843f None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:02.028432 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec06af-b678-4cac-a789-bc538a52843f None admin] PATH_INFO: `/v3/roles` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:02.030451 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dec06af-b678-4cac-a789-bc538a52843f None admin] RBAC: Adding query filter params (name=reader) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:02.031000 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dec06af-b678-4cac-a789-bc538a52843f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:02.033621 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dec06af-b678-4cac-a789-bc538a52843f None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:02.050142 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 133/280] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jul 26 15:25:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:02.051625 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dec06af-b678-4cac-a789-bc538a52843f None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:02.084193 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 148/281] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Jul 26 15:25:01 2022] POST /identity/v3/users => generated 293 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:25:02.085375 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3c4148-8dec-49bd-9cef-b4dcfa5b99f3 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:02.283807 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dec06af-b678-4cac-a789-bc538a52843f None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:02.308754 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3c4148-8dec-49bd-9cef-b4dcfa5b99f3 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:02.313103 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:02.321420 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:02.351774 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df45a74f-c1f3-40c0-b628-d111fabe3639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:02.352523 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df45a74f-c1f3-40c0-b628-d111fabe3639 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:02.352832 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df45a74f-c1f3-40c0-b628-d111fabe3639 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:02.353372 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df45a74f-c1f3-40c0-b628-d111fabe3639 None admin] PATH_INFO: `/v3/users/4a25bedd21164ed0a20dd7c4835e5305` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:02.355188 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df45a74f-c1f3-40c0-b628-d111fabe3639 None admin] RBAC: Authorizing `identity:get_user(user_id=4a25bedd21164ed0a20dd7c4835e5305)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:02.358053 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df45a74f-c1f3-40c0-b628-d111fabe3639 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:02.358309 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2332deaa-ae1f-4852-b1da-ae302f9fa418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:02.359200 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2332deaa-ae1f-4852-b1da-ae302f9fa418 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:02.359684 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2332deaa-ae1f-4852-b1da-ae302f9fa418 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:02.360176 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2332deaa-ae1f-4852-b1da-ae302f9fa418 None admin] PATH_INFO: `/v3/users/2adf77bba1d84cabb15b4fbea747cdb8` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:02.361218 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 149/282] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 26 15:25:02 2022] GET /identity/v3/users/4a25bedd21164ed0a20dd7c4835e5305 => generated 297 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:02.371003 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df45a74f-c1f3-40c0-b628-d111fabe3639 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:02.393974 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2332deaa-ae1f-4852-b1da-ae302f9fa418 None admin] RBAC: Authorizing `identity:get_user(user_id=2adf77bba1d84cabb15b4fbea747cdb8)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:02.397021 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2332deaa-ae1f-4852-b1da-ae302f9fa418 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:02.400569 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 134/283] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 26 15:25:02 2022] GET /identity/v3/users/2adf77bba1d84cabb15b4fbea747cdb8 => generated 293 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:02.411197 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2332deaa-ae1f-4852-b1da-ae302f9fa418 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:02.593823 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df45a74f-c1f3-40c0-b628-d111fabe3639 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:02.615728 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2332deaa-ae1f-4852-b1da-ae302f9fa418 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:02.645449 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f2fdc8-eef2-4848-b162-815fde9fdaec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:02.646302 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f2fdc8-eef2-4848-b162-815fde9fdaec None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:02.646593 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f2fdc8-eef2-4848-b162-815fde9fdaec None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:02.646963 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f2fdc8-eef2-4848-b162-815fde9fdaec None admin] PATH_INFO: `/v3/projects/24c3fa325d8a41dc8ac86599b7fb5180` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:02.649837 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f2fdc8-eef2-4848-b162-815fde9fdaec None admin] RBAC: Authorizing `identity:get_project(project_id=24c3fa325d8a41dc8ac86599b7fb5180)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:02.651750 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f2fdc8-eef2-4848-b162-815fde9fdaec None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:02.653947 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 150/284] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 15:25:02 2022] GET /identity/v3/projects/24c3fa325d8a41dc8ac86599b7fb5180 => generated 302 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:25:02.660537 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f2fdc8-eef2-4848-b162-815fde9fdaec None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:02.708325 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68841d8-5499-427e-9048-ada32e578bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:02.709824 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68841d8-5499-427e-9048-ada32e578bd0 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:02.710604 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68841d8-5499-427e-9048-ada32e578bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:02.711319 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68841d8-5499-427e-9048-ada32e578bd0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:02.712848 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68841d8-5499-427e-9048-ada32e578bd0 None admin] RBAC: Adding query filter params (role.id=fd8f80bccab248edbb1d09ec187a8113, user.id=2adf77bba1d84cabb15b4fbea747cdb8, scope.system=all) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:02.713589 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68841d8-5499-427e-9048-ada32e578bd0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:02.716336 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68841d8-5499-427e-9048-ada32e578bd0 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:02.743584 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:02.745283 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 135/285] 10.222.0.18 () {56 vars in 1308 bytes} [Tue Jul 26 15:25:02 2022] GET /identity/v3/role_assignments?user.id=2adf77bba1d84cabb15b4fbea747cdb8&scope.system=all&role.id=fd8f80bccab248edbb1d09ec187a8113 => generated 226 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:25:02.759663 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ba0fa-cac2-405c-aaf8-62b4448b31ea None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:02.759950 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ba0fa-cac2-405c-aaf8-62b4448b31ea None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:02.760238 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ba0fa-cac2-405c-aaf8-62b4448b31ea None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:02.761694 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 136/286] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:25:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 15:25:02.768020 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b3e8f-8825-4ab4-a670-294c55f7a60f None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:02.768397 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b3e8f-8825-4ab4-a670-294c55f7a60f None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:02.768571 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b3e8f-8825-4ab4-a670-294c55f7a60f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:02.788640 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-a06b3e8f-8825-4ab4-a670-294c55f7a60f None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:25:02.789901 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-a06b3e8f-8825-4ab4-a670-294c55f7a60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:25:02.800391 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f2fdc8-eef2-4848-b162-815fde9fdaec None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:02.833462 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:02.846515 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4658cbb1-617e-41c8-a0d0-ec78cc73cca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:02.847122 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4658cbb1-617e-41c8-a0d0-ec78cc73cca0 None admin] REQUEST_METHOD: `PUT` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:02.848466 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4658cbb1-617e-41c8-a0d0-ec78cc73cca0 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:02.848753 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4658cbb1-617e-41c8-a0d0-ec78cc73cca0 None admin] PATH_INFO: `/v3/projects/24c3fa325d8a41dc8ac86599b7fb5180/users/4a25bedd21164ed0a20dd7c4835e5305/roles/c692edefa26c417c8d43da5d89ec8462` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:02.854983 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4658cbb1-617e-41c8-a0d0-ec78cc73cca0 None admin] RBAC: Authorizing `identity:create_grant(project_id=24c3fa325d8a41dc8ac86599b7fb5180, user_id=4a25bedd21164ed0a20dd7c4835e5305, role_id=c692edefa26c417c8d43da5d89ec8462)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:02.862926 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4658cbb1-617e-41c8-a0d0-ec78cc73cca0 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:02.899915 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 137/287] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:25:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:25:02.925886 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06b3e8f-8825-4ab4-a670-294c55f7a60f None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:02.958361 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 151/288] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jul 26 15:25:02 2022] PUT /identity/v3/projects/24c3fa325d8a41dc8ac86599b7fb5180/users/4a25bedd21164ed0a20dd7c4835e5305/roles/c692edefa26c417c8d43da5d89ec8462 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:25:03.060432 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06b3e8f-8825-4ab4-a670-294c55f7a60f None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:03.103235 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8679a8-25bc-4802-9a9a-b63d6b412390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:03.103801 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8679a8-25bc-4802-9a9a-b63d6b412390 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:03.104086 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8679a8-25bc-4802-9a9a-b63d6b412390 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:03.104367 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8679a8-25bc-4802-9a9a-b63d6b412390 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:03.117755 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8679a8-25bc-4802-9a9a-b63d6b412390 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:25:03.122952 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application [None req-ed8679a8-25bc-4802-9a9a-b63d6b412390 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 15:25:03.122952 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:25:03.122952 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:25:03.122952 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:25:03.122952 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:25:03.122952 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:25:03.122952 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:25:03.122952 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:25:03.122952 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:25:03.122952 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:25:03.122952 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:25:03.122952 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:25:03.122952 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:25:03.122952 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:25:03.122952 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:25:03.122952 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:25:03.124500 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:25:03.124500 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:25:03.124500 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:25:03.124500 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:25:03.124500 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:25:03.124500 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:25:03.124500 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:25:03.124500 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:25:03.124500 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:25:03.124500 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:25:03.124500 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:25:03.124500 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application with Lock( Jul 26 15:25:03.124500 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:25:03.124500 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:25:03.124500 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:25:03.124500 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:25:03.125285 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:25:03.125285 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:25:03.125285 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:25:03.125285 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:25:03.125285 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:25:03.125285 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:25:03.125285 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:25:03.125285 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:25:03.125285 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:25:03.125285 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:25:03.125285 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 15:25:03.125285 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:25:03.125285 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 138/289] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 15:25:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 15:25:03.131308 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4658cbb1-617e-41c8-a0d0-ec78cc73cca0 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:03.261663 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4658cbb1-617e-41c8-a0d0-ec78cc73cca0 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:03.274975 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:03.309672 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadd187d-b555-46d5-8c3b-8426c902d400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:03.310538 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadd187d-b555-46d5-8c3b-8426c902d400 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:03.310871 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadd187d-b555-46d5-8c3b-8426c902d400 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:03.311323 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadd187d-b555-46d5-8c3b-8426c902d400 None admin] PATH_INFO: `/v3/roles` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:03.312481 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadd187d-b555-46d5-8c3b-8426c902d400 None admin] RBAC: Adding query filter params (name=member) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:03.312845 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadd187d-b555-46d5-8c3b-8426c902d400 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:03.314365 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadd187d-b555-46d5-8c3b-8426c902d400 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:03.324578 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 152/290] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jul 26 15:25:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:03.330987 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8679a8-25bc-4802-9a9a-b63d6b412390 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:03.360796 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:03.444361 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8679a8-25bc-4802-9a9a-b63d6b412390 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:03.484271 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b010d7ef-6e41-4155-a60d-26d1ac038334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:03.485006 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b010d7ef-6e41-4155-a60d-26d1ac038334 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:03.485285 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b010d7ef-6e41-4155-a60d-26d1ac038334 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:03.485609 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b010d7ef-6e41-4155-a60d-26d1ac038334 None admin] PATH_INFO: `/v3/users/9e0e095c863d436fa8ff95625f8a10f2` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:03.486848 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b010d7ef-6e41-4155-a60d-26d1ac038334 None admin] RBAC: Authorizing `identity:get_user(user_id=9e0e095c863d436fa8ff95625f8a10f2)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:03.488444 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b010d7ef-6e41-4155-a60d-26d1ac038334 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:03.490190 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 139/291] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 26 15:25:03 2022] GET /identity/v3/users/9e0e095c863d436fa8ff95625f8a10f2 => generated 297 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:03.495891 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadd187d-b555-46d5-8c3b-8426c902d400 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:03.611488 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadd187d-b555-46d5-8c3b-8426c902d400 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:03.651071 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ea35c0-2797-40a9-b674-3f536376b54d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:03.651719 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea35c0-2797-40a9-b674-3f536376b54d None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:03.652008 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea35c0-2797-40a9-b674-3f536376b54d None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:03.652287 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea35c0-2797-40a9-b674-3f536376b54d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:03.708270 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:03.763082 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ea35c0-2797-40a9-b674-3f536376b54d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:03.765249 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ea35c0-2797-40a9-b674-3f536376b54d None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:03.901260 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 153/292] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 15:25:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 15:25:03.906837 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b010d7ef-6e41-4155-a60d-26d1ac038334 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:04.015995 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:04.031799 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b010d7ef-6e41-4155-a60d-26d1ac038334 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:04.099947 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2d39e9-54d7-470b-8973-23786d17862a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:04.101059 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d39e9-54d7-470b-8973-23786d17862a None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:04.101560 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d39e9-54d7-470b-8973-23786d17862a None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:04.102051 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d39e9-54d7-470b-8973-23786d17862a None admin] PATH_INFO: `/v3/projects/24c3fa325d8a41dc8ac86599b7fb5180` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:04.104206 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2d39e9-54d7-470b-8973-23786d17862a None admin] RBAC: Authorizing `identity:get_project(project_id=24c3fa325d8a41dc8ac86599b7fb5180)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:04.106910 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2d39e9-54d7-470b-8973-23786d17862a None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:04.111396 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 140/293] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 15:25:03 2022] GET /identity/v3/projects/24c3fa325d8a41dc8ac86599b7fb5180 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:04.116893 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ea35c0-2797-40a9-b674-3f536376b54d None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:04.214068 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:04.267473 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ea35c0-2797-40a9-b674-3f536376b54d None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:04.318265 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b302791-df80-4df3-8dbb-a5d30bcc7ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:04.318942 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b302791-df80-4df3-8dbb-a5d30bcc7ab7 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:04.319269 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b302791-df80-4df3-8dbb-a5d30bcc7ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:04.319552 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b302791-df80-4df3-8dbb-a5d30bcc7ab7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:04.320437 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b302791-df80-4df3-8dbb-a5d30bcc7ab7 None admin] RBAC: Adding query filter params (role.id=fd8f80bccab248edbb1d09ec187a8113, scope.project.id=24c3fa325d8a41dc8ac86599b7fb5180, user.id=9e0e095c863d436fa8ff95625f8a10f2) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:04.320844 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b302791-df80-4df3-8dbb-a5d30bcc7ab7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:04.322411 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b302791-df80-4df3-8dbb-a5d30bcc7ab7 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:04.332657 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 154/294] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 26 15:25:04 2022] GET /identity/v3/role_assignments?user.id=9e0e095c863d436fa8ff95625f8a10f2&scope.project.id=24c3fa325d8a41dc8ac86599b7fb5180&role.id=fd8f80bccab248edbb1d09ec187a8113 => generated 608 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:05.272145 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed6a3e-1c3b-4e9d-8e51-52659fb9f486 None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:05.272664 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed6a3e-1c3b-4e9d-8e51-52659fb9f486 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:05.272740 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed6a3e-1c3b-4e9d-8e51-52659fb9f486 None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:05.274422 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 141/295] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:25:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:25:05.280793 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48286565-4cd0-4262-b345-feeb8f5d1b76 None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:05.281330 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48286565-4cd0-4262-b345-feeb8f5d1b76 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:05.281330 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48286565-4cd0-4262-b345-feeb8f5d1b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:05.302372 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-48286565-4cd0-4262-b345-feeb8f5d1b76 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:25:05.303690 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-48286565-4cd0-4262-b345-feeb8f5d1b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:25:05.391291 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 155/296] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:25:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:25:05.411544 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ed6a3e-1c3b-4e9d-8e51-52659fb9f486 None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:05.590269 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ed6a3e-1c3b-4e9d-8e51-52659fb9f486 None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:05.661285 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f8862d-55db-495b-a0ed-ab22fab56ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:05.662425 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f8862d-55db-495b-a0ed-ab22fab56ff3 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:05.662938 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f8862d-55db-495b-a0ed-ab22fab56ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:05.663630 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f8862d-55db-495b-a0ed-ab22fab56ff3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:05.665834 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f8862d-55db-495b-a0ed-ab22fab56ff3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:05.669159 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f8862d-55db-495b-a0ed-ab22fab56ff3 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:05.673248 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 142/297] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 15:25:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:05.680594 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48286565-4cd0-4262-b345-feeb8f5d1b76 None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:05.788900 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:05.832303 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48286565-4cd0-4262-b345-feeb8f5d1b76 None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:05.871259 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d42ff34-4c9c-4e9b-87db-319d68fd62a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:05.871837 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d42ff34-4c9c-4e9b-87db-319d68fd62a6 None admin] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:05.872127 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d42ff34-4c9c-4e9b-87db-319d68fd62a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:05.872409 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d42ff34-4c9c-4e9b-87db-319d68fd62a6 None admin] PATH_INFO: `/v3/groups` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:05.873733 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d42ff34-4c9c-4e9b-87db-319d68fd62a6 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:05.875270 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d42ff34-4c9c-4e9b-87db-319d68fd62a6 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:05.891250 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3b33a-1509-4cd3-a0e2-24b5f703749d None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:05.891631 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3b33a-1509-4cd3-a0e2-24b5f703749d None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:05.897689 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3b33a-1509-4cd3-a0e2-24b5f703749d None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:05.897689 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 143/298] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:25:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 15:25:05.899095 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bd3a70-b091-4192-a53a-9224d39d92c5 None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:05.899439 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bd3a70-b091-4192-a53a-9224d39d92c5 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:05.899704 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bd3a70-b091-4192-a53a-9224d39d92c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:05.921155 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-55bd3a70-b091-4192-a53a-9224d39d92c5 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:25:05.922480 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-55bd3a70-b091-4192-a53a-9224d39d92c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:25:05.970841 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 156/299] 10.222.0.18 () {60 vars in 1134 bytes} [Tue Jul 26 15:25:05 2022] POST /identity/v3/groups => generated 229 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:25:05.973214 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:06.078286 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 144/300] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:25:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 15:25:06.085160 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9ac6e-d68b-4ab6-850a-558116fb4ec4 None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:06.085482 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9ac6e-d68b-4ab6-850a-558116fb4ec4 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:06.085726 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9ac6e-d68b-4ab6-850a-558116fb4ec4 None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:06.087373 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 157/301] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:25:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:25:06.094771 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c09e1d-0c68-4e39-9655-caca694d47d8 None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:06.096187 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c09e1d-0c68-4e39-9655-caca694d47d8 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:06.096482 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c09e1d-0c68-4e39-9655-caca694d47d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:06.111838 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b9ac6e-d68b-4ab6-850a-558116fb4ec4 None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:06.125156 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-a6c09e1d-0c68-4e39-9655-caca694d47d8 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:25:06.126348 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-a6c09e1d-0c68-4e39-9655-caca694d47d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:25:06.221014 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 145/302] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:25:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:25:06.223122 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798efc5f-87fe-41b0-8c8d-0476a5d8735e None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:06.223729 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798efc5f-87fe-41b0-8c8d-0476a5d8735e None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:06.224188 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798efc5f-87fe-41b0-8c8d-0476a5d8735e None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:06.226765 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 146/303] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:25:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:25:06.236201 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2621ae-d33f-4ac8-85a7-ff9212860902 None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:06.236775 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2621ae-d33f-4ac8-85a7-ff9212860902 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:06.237312 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2621ae-d33f-4ac8-85a7-ff9212860902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:06.270771 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-6f2621ae-d33f-4ac8-85a7-ff9212860902 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:25:06.273147 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-6f2621ae-d33f-4ac8-85a7-ff9212860902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:25:06.276186 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b9ac6e-d68b-4ab6-850a-558116fb4ec4 None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:06.306671 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:06.327781 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03293df6-1ad0-4ab4-8a6a-fe05ef07d644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:06.328896 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03293df6-1ad0-4ab4-8a6a-fe05ef07d644 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:06.329415 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03293df6-1ad0-4ab4-8a6a-fe05ef07d644 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:06.330017 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03293df6-1ad0-4ab4-8a6a-fe05ef07d644 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:06.352234 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03293df6-1ad0-4ab4-8a6a-fe05ef07d644 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:25:06.362728 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-03293df6-1ad0-4ab4-8a6a-fe05ef07d644 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 15:25:06.362728 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:25:06.362728 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:25:06.362728 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:25:06.362728 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:25:06.362728 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:25:06.362728 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:25:06.362728 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:25:06.362728 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:25:06.362728 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:25:06.362728 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:25:06.362728 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:25:06.362728 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:25:06.362728 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:25:06.362728 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:25:06.362728 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:25:06.364112 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:25:06.364112 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:25:06.364112 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:25:06.364112 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:25:06.364112 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:25:06.364112 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:25:06.364112 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:25:06.364112 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:25:06.364112 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:25:06.364112 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:25:06.364112 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:25:06.364112 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:25:06.364112 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:25:06.364112 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:25:06.364112 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:25:06.364112 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:25:06.365013 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:25:06.365013 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:25:06.365013 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:25:06.365013 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:25:06.365013 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:25:06.365013 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:25:06.365013 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:25:06.365013 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:25:06.365013 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:25:06.365013 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:25:06.365013 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 15:25:06.365013 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:25:06.365783 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 158/304] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 15:25:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:25:06.367542 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03293df6-1ad0-4ab4-8a6a-fe05ef07d644 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:06.385721 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 147/305] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:25:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:25:06.385721 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2621ae-d33f-4ac8-85a7-ff9212860902 None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:06.418279 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:06.551254 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2621ae-d33f-4ac8-85a7-ff9212860902 None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:06.551532 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03293df6-1ad0-4ab4-8a6a-fe05ef07d644 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:06.596605 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fda47ff-16e9-41db-b66b-18f86e461ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:06.597583 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda47ff-16e9-41db-b66b-18f86e461ef6 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:06.598027 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda47ff-16e9-41db-b66b-18f86e461ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:06.598445 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda47ff-16e9-41db-b66b-18f86e461ef6 None admin] PATH_INFO: `/v3/roles` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:06.599660 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fda47ff-16e9-41db-b66b-18f86e461ef6 None admin] RBAC: Adding query filter params (name=member) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:06.600108 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fda47ff-16e9-41db-b66b-18f86e461ef6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:06.601878 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fda47ff-16e9-41db-b66b-18f86e461ef6 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:06.613473 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 148/306] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jul 26 15:25:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:06.614598 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fda47ff-16e9-41db-b66b-18f86e461ef6 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:06.619026 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2ed224-6067-4b4f-8153-6eda38d93249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:06.620207 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ed224-6067-4b4f-8153-6eda38d93249 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:06.620723 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ed224-6067-4b4f-8153-6eda38d93249 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:06.621227 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ed224-6067-4b4f-8153-6eda38d93249 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:06.642590 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2ed224-6067-4b4f-8153-6eda38d93249 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:25:06.653679 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-4e2ed224-6067-4b4f-8153-6eda38d93249 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 15:25:06.653679 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:25:06.653679 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:25:06.653679 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:25:06.653679 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:25:06.653679 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:25:06.653679 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:25:06.653679 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:25:06.653679 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:25:06.653679 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:25:06.653679 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:25:06.653679 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:25:06.653679 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:25:06.653679 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:25:06.653679 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:25:06.653679 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:25:06.654804 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:25:06.654804 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:25:06.654804 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:25:06.654804 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:25:06.654804 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:25:06.654804 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:25:06.654804 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:25:06.654804 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:25:06.654804 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:25:06.654804 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:25:06.654804 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:25:06.654804 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:25:06.654804 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:25:06.654804 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:25:06.654804 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:25:06.654804 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:25:06.655680 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:25:06.655680 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:25:06.655680 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:25:06.655680 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:25:06.655680 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:25:06.655680 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:25:06.655680 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:25:06.655680 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:25:06.655680 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:25:06.655680 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:25:06.655680 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 15:25:06.655680 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:25:06.657626 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 159/307] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 15:25:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:25:06.657626 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2ed224-6067-4b4f-8153-6eda38d93249 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:06.742451 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:06.743922 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:06.770532 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fda47ff-16e9-41db-b66b-18f86e461ef6 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:06.826582 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ae2eac-9e38-47f4-9479-e477329e62f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:06.827745 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae2eac-9e38-47f4-9479-e477329e62f0 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:06.828243 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae2eac-9e38-47f4-9479-e477329e62f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:06.828736 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae2eac-9e38-47f4-9479-e477329e62f0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:06.849609 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ae2eac-9e38-47f4-9479-e477329e62f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:25:06.851711 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2ed224-6067-4b4f-8153-6eda38d93249 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:06.860802 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application [None req-16ae2eac-9e38-47f4-9479-e477329e62f0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 15:25:06.860802 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:25:06.860802 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:25:06.860802 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:25:06.860802 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:25:06.860802 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:25:06.860802 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:25:06.860802 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:25:06.860802 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:25:06.860802 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:25:06.860802 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:25:06.860802 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:25:06.860802 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:25:06.860802 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:25:06.860802 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:25:06.860802 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:25:06.861721 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:25:06.861721 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:25:06.861721 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:25:06.861721 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:25:06.861721 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:25:06.861721 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:25:06.861721 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:25:06.861721 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:25:06.861721 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:25:06.861721 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:25:06.861721 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:25:06.861721 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application with Lock( Jul 26 15:25:06.861721 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:25:06.861721 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:25:06.861721 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:25:06.861721 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:25:06.862514 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:25:06.862514 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:25:06.862514 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:25:06.862514 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:25:06.862514 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:25:06.862514 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:25:06.862514 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:25:06.862514 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:25:06.862514 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:25:06.862514 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:25:06.862514 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 15:25:06.862514 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:25:06.863739 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 149/308] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 15:25:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:25:06.864868 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ae2eac-9e38-47f4-9479-e477329e62f0 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:06.915506 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20504caa-4024-49b8-9bf6-af4e920b9d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:06.916531 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20504caa-4024-49b8-9bf6-af4e920b9d7f None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:06.917019 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20504caa-4024-49b8-9bf6-af4e920b9d7f None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:06.917524 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20504caa-4024-49b8-9bf6-af4e920b9d7f None admin] PATH_INFO: `/v3/users/2adf77bba1d84cabb15b4fbea747cdb8` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:06.919939 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20504caa-4024-49b8-9bf6-af4e920b9d7f None admin] RBAC: Authorizing `identity:get_user(user_id=2adf77bba1d84cabb15b4fbea747cdb8)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:06.922741 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20504caa-4024-49b8-9bf6-af4e920b9d7f None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:06.926052 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 160/309] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 26 15:25:06 2022] GET /identity/v3/users/2adf77bba1d84cabb15b4fbea747cdb8 => generated 293 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:06.930742 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20504caa-4024-49b8-9bf6-af4e920b9d7f None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:07.012852 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ae2eac-9e38-47f4-9479-e477329e62f0 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:07.074222 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efee349-65c3-4e1b-a38f-a0ecda3f380c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:07.075416 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efee349-65c3-4e1b-a38f-a0ecda3f380c None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:07.076059 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efee349-65c3-4e1b-a38f-a0ecda3f380c None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:07.076648 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efee349-65c3-4e1b-a38f-a0ecda3f380c None admin] PATH_INFO: `/v3/roles` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:07.077694 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efee349-65c3-4e1b-a38f-a0ecda3f380c None admin] RBAC: Adding query filter params (name=reader) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:07.078219 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efee349-65c3-4e1b-a38f-a0ecda3f380c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:07.080615 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efee349-65c3-4e1b-a38f-a0ecda3f380c None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:07.094747 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 150/310] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jul 26 15:25:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:07.096231 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efee349-65c3-4e1b-a38f-a0ecda3f380c None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:07.103274 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:07.124311 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20504caa-4024-49b8-9bf6-af4e920b9d7f None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:07.145506 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:07.190380 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50928cb-b5f6-4655-abe6-ed20d269de29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:07.191397 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50928cb-b5f6-4655-abe6-ed20d269de29 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:07.191906 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50928cb-b5f6-4655-abe6-ed20d269de29 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:07.192405 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50928cb-b5f6-4655-abe6-ed20d269de29 None admin] PATH_INFO: `/v3/roles` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:07.194004 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50928cb-b5f6-4655-abe6-ed20d269de29 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:07.194547 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50928cb-b5f6-4655-abe6-ed20d269de29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:07.197338 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50928cb-b5f6-4655-abe6-ed20d269de29 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:07.216635 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 161/311] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jul 26 15:25:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:07.221029 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50928cb-b5f6-4655-abe6-ed20d269de29 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:07.259482 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efee349-65c3-4e1b-a38f-a0ecda3f380c None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:07.325624 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781cf375-91b0-40aa-ab81-9484d5ab9226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:07.328389 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781cf375-91b0-40aa-ab81-9484d5ab9226 None admin] REQUEST_METHOD: `PUT` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:07.329095 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781cf375-91b0-40aa-ab81-9484d5ab9226 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:07.329542 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781cf375-91b0-40aa-ab81-9484d5ab9226 None admin] PATH_INFO: `/v3/system/users/2adf77bba1d84cabb15b4fbea747cdb8/roles/fd8f80bccab248edbb1d09ec187a8113` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:07.332287 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781cf375-91b0-40aa-ab81-9484d5ab9226 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=2adf77bba1d84cabb15b4fbea747cdb8, role_id=fd8f80bccab248edbb1d09ec187a8113)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:07.334768 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781cf375-91b0-40aa-ab81-9484d5ab9226 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:07.376107 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50928cb-b5f6-4655-abe6-ed20d269de29 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:07.414258 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 151/312] 10.222.0.18 () {58 vars in 1334 bytes} [Tue Jul 26 15:25:07 2022] PUT /identity/v3/system/users/2adf77bba1d84cabb15b4fbea747cdb8/roles/fd8f80bccab248edbb1d09ec187a8113 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:25:07.415159 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781cf375-91b0-40aa-ab81-9484d5ab9226 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:07.421915 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df38bf2-6493-4dab-8075-32542d6c8405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:07.422820 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df38bf2-6493-4dab-8075-32542d6c8405 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:07.423265 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df38bf2-6493-4dab-8075-32542d6c8405 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:07.423735 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df38bf2-6493-4dab-8075-32542d6c8405 None admin] PATH_INFO: `/v3/users/4a25bedd21164ed0a20dd7c4835e5305` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:07.426575 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df38bf2-6493-4dab-8075-32542d6c8405 None admin] RBAC: Authorizing `identity:get_user(user_id=4a25bedd21164ed0a20dd7c4835e5305)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:07.428904 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df38bf2-6493-4dab-8075-32542d6c8405 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:07.439042 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 162/313] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 26 15:25:07 2022] GET /identity/v3/users/4a25bedd21164ed0a20dd7c4835e5305 => generated 297 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:07.443361 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df38bf2-6493-4dab-8075-32542d6c8405 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:07.539778 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:07.581305 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:07.645886 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781cf375-91b0-40aa-ab81-9484d5ab9226 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:07.690196 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df38bf2-6493-4dab-8075-32542d6c8405 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:07.712044 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73db4c4-70c4-4cff-89ad-4785d40d0903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:07.712870 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73db4c4-70c4-4cff-89ad-4785d40d0903 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:07.713176 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73db4c4-70c4-4cff-89ad-4785d40d0903 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:07.713522 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73db4c4-70c4-4cff-89ad-4785d40d0903 None admin] PATH_INFO: `/v3/users/a6c57fd2eccf4745af0f9956cdae2ae2` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:07.738789 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73db4c4-70c4-4cff-89ad-4785d40d0903 None admin] RBAC: Authorizing `identity:get_user(user_id=a6c57fd2eccf4745af0f9956cdae2ae2)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:07.740638 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73db4c4-70c4-4cff-89ad-4785d40d0903 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:07.743194 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 152/314] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 26 15:25:07 2022] GET /identity/v3/users/a6c57fd2eccf4745af0f9956cdae2ae2 => generated 293 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:07.750660 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73db4c4-70c4-4cff-89ad-4785d40d0903 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:07.763338 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3db6e5b-cf4b-4ee2-86a0-78ed2631d2f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:07.766297 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db6e5b-cf4b-4ee2-86a0-78ed2631d2f9 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:07.767717 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db6e5b-cf4b-4ee2-86a0-78ed2631d2f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:07.768903 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db6e5b-cf4b-4ee2-86a0-78ed2631d2f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:07.881627 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3db6e5b-cf4b-4ee2-86a0-78ed2631d2f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:07.883334 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3db6e5b-cf4b-4ee2-86a0-78ed2631d2f9 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:07.916356 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73db4c4-70c4-4cff-89ad-4785d40d0903 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:07.941483 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:07.953816 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:07.965914 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff2b5b3-eed5-4ea3-a07f-a07c6bf87ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:07.966494 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff2b5b3-eed5-4ea3-a07f-a07c6bf87ae9 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:07.967369 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff2b5b3-eed5-4ea3-a07f-a07c6bf87ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:07.967651 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff2b5b3-eed5-4ea3-a07f-a07c6bf87ae9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:07.968522 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff2b5b3-eed5-4ea3-a07f-a07c6bf87ae9 None admin] RBAC: Adding query filter params (role.id=c692edefa26c417c8d43da5d89ec8462, user.id=a6c57fd2eccf4745af0f9956cdae2ae2, scope.system=all) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:07.968836 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff2b5b3-eed5-4ea3-a07f-a07c6bf87ae9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:07.970314 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff2b5b3-eed5-4ea3-a07f-a07c6bf87ae9 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:07.976065 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 153/315] 10.222.0.18 () {56 vars in 1308 bytes} [Tue Jul 26 15:25:07 2022] GET /identity/v3/role_assignments?user.id=a6c57fd2eccf4745af0f9956cdae2ae2&scope.system=all&role.id=c692edefa26c417c8d43da5d89ec8462 => generated 226 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:25:08.062683 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 163/316] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 15:25:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 622 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 26 15:25:08.068536 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff2b5b3-eed5-4ea3-a07f-a07c6bf87ae9 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:08.249374 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff2b5b3-eed5-4ea3-a07f-a07c6bf87ae9 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:08.306715 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0c3e71-53d3-424b-8d7a-9b41151b090f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:08.307763 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c3e71-53d3-424b-8d7a-9b41151b090f None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:08.308048 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c3e71-53d3-424b-8d7a-9b41151b090f None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:08.308422 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c3e71-53d3-424b-8d7a-9b41151b090f None admin] PATH_INFO: `/v3/projects/24c3fa325d8a41dc8ac86599b7fb5180` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:08.310544 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0c3e71-53d3-424b-8d7a-9b41151b090f None admin] RBAC: Authorizing `identity:get_project(project_id=24c3fa325d8a41dc8ac86599b7fb5180)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:08.312678 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0c3e71-53d3-424b-8d7a-9b41151b090f None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:08.319278 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 154/317] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 15:25:08 2022] GET /identity/v3/projects/24c3fa325d8a41dc8ac86599b7fb5180 => generated 302 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:08.321073 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3db6e5b-cf4b-4ee2-86a0-78ed2631d2f9 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:08.418834 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a47b7-c25e-465d-8016-d8565ee8d967 None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:08.419902 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a47b7-c25e-465d-8016-d8565ee8d967 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:08.419902 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a47b7-c25e-465d-8016-d8565ee8d967 None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:08.421127 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 155/318] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:25:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 15:25:08.426858 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc8fea7-ada6-4fed-a98f-5a4045969657 None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:08.427224 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc8fea7-ada6-4fed-a98f-5a4045969657 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:08.427459 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc8fea7-ada6-4fed-a98f-5a4045969657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:08.454018 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-dcc8fea7-ada6-4fed-a98f-5a4045969657 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:25:08.455982 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-dcc8fea7-ada6-4fed-a98f-5a4045969657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:25:08.462949 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3db6e5b-cf4b-4ee2-86a0-78ed2631d2f9 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:08.517350 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f970f40-49e6-4362-92b9-46442a6f4cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:08.521473 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f970f40-49e6-4362-92b9-46442a6f4cc8 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:08.522229 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f970f40-49e6-4362-92b9-46442a6f4cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:08.522833 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f970f40-49e6-4362-92b9-46442a6f4cc8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:08.524765 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f970f40-49e6-4362-92b9-46442a6f4cc8 None admin] RBAC: Adding query filter params (role.id=c692edefa26c417c8d43da5d89ec8462, scope.project.id=24c3fa325d8a41dc8ac86599b7fb5180, user.id=4a25bedd21164ed0a20dd7c4835e5305) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:08.525616 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f970f40-49e6-4362-92b9-46442a6f4cc8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:08.528596 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f970f40-49e6-4362-92b9-46442a6f4cc8 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:08.539564 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 164/319] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 26 15:25:08 2022] GET /identity/v3/role_assignments?user.id=4a25bedd21164ed0a20dd7c4835e5305&scope.project.id=24c3fa325d8a41dc8ac86599b7fb5180&role.id=c692edefa26c417c8d43da5d89ec8462 => generated 608 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:08.556774 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:08.593059 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 156/320] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:25:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 15:25:08.630489 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f970f40-49e6-4362-92b9-46442a6f4cc8 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:08.637476 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:08.794732 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f970f40-49e6-4362-92b9-46442a6f4cc8 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:08.840391 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4d98cf-4938-492e-b03b-395ad4c3d0f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:08.841027 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4d98cf-4938-492e-b03b-395ad4c3d0f6 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:08.841365 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4d98cf-4938-492e-b03b-395ad4c3d0f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:08.842479 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4d98cf-4938-492e-b03b-395ad4c3d0f6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:08.844158 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4d98cf-4938-492e-b03b-395ad4c3d0f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:08.845684 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4d98cf-4938-492e-b03b-395ad4c3d0f6 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:08.847820 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 165/321] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 15:25:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:08.856645 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc8fea7-ada6-4fed-a98f-5a4045969657 None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:09.020053 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc8fea7-ada6-4fed-a98f-5a4045969657 None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:09.084496 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b66571-c83c-4096-8f57-bd49f15e6270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:09.085030 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b66571-c83c-4096-8f57-bd49f15e6270 None admin] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:09.085306 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b66571-c83c-4096-8f57-bd49f15e6270 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:09.085573 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b66571-c83c-4096-8f57-bd49f15e6270 None admin] PATH_INFO: `/v3/groups` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:09.086288 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b66571-c83c-4096-8f57-bd49f15e6270 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:09.087800 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b66571-c83c-4096-8f57-bd49f15e6270 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:09.197465 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 157/322] 10.222.0.18 () {60 vars in 1134 bytes} [Tue Jul 26 15:25:08 2022] POST /identity/v3/groups => generated 226 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:25:09.907903 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda87c7-18c5-40be-a834-92234c69d16f None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:09.908434 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda87c7-18c5-40be-a834-92234c69d16f None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:09.908434 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda87c7-18c5-40be-a834-92234c69d16f None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:09.910287 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 166/323] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:25:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:25:09.917243 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d94601d-c6a6-4d57-bd94-1ed6d131ba03 None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:09.917771 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d94601d-c6a6-4d57-bd94-1ed6d131ba03 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:09.917771 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d94601d-c6a6-4d57-bd94-1ed6d131ba03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:09.939275 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-3d94601d-c6a6-4d57-bd94-1ed6d131ba03 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:25:09.940497 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-3d94601d-c6a6-4d57-bd94-1ed6d131ba03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:25:09.998993 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:10.033284 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 158/324] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:25:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:25:10.061253 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bda87c7-18c5-40be-a834-92234c69d16f None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:10.149364 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:10.189078 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bda87c7-18c5-40be-a834-92234c69d16f None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:10.231835 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4aac28-a813-478d-a24b-2367ca684681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:10.233076 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4aac28-a813-478d-a24b-2367ca684681 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:10.233365 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4aac28-a813-478d-a24b-2367ca684681 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:10.233643 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4aac28-a813-478d-a24b-2367ca684681 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:10.245962 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4aac28-a813-478d-a24b-2367ca684681 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:25:10.251980 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-6e4aac28-a813-478d-a24b-2367ca684681 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 15:25:10.251980 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:25:10.251980 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:25:10.251980 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:25:10.251980 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:25:10.251980 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:25:10.251980 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:25:10.251980 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:25:10.251980 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:25:10.251980 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:25:10.251980 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:25:10.251980 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:25:10.251980 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:25:10.251980 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:25:10.251980 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:25:10.251980 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:25:10.252905 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:25:10.252905 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:25:10.252905 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:25:10.252905 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:25:10.252905 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:25:10.252905 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:25:10.252905 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:25:10.252905 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:25:10.252905 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:25:10.252905 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:25:10.252905 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:25:10.252905 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:25:10.252905 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:25:10.252905 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:25:10.252905 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:25:10.252905 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:25:10.254172 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:25:10.254172 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:25:10.254172 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:25:10.254172 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:25:10.254172 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:25:10.254172 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:25:10.254172 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:25:10.254172 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:25:10.254172 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:25:10.254172 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:25:10.254172 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 15:25:10.254172 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:25:10.254172 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 167/325] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 15:25:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:25:10.261834 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d94601d-c6a6-4d57-bd94-1ed6d131ba03 None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:10.407166 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d94601d-c6a6-4d57-bd94-1ed6d131ba03 None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:10.463005 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4f0c2d-4b75-411f-b9e6-126bb4719ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:10.464122 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f0c2d-4b75-411f-b9e6-126bb4719ef3 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:10.464705 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f0c2d-4b75-411f-b9e6-126bb4719ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:10.465181 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f0c2d-4b75-411f-b9e6-126bb4719ef3 None admin] PATH_INFO: `/v3/roles` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:10.466182 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4f0c2d-4b75-411f-b9e6-126bb4719ef3 None admin] RBAC: Adding query filter params (name=member) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:10.466779 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4f0c2d-4b75-411f-b9e6-126bb4719ef3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:10.468494 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4f0c2d-4b75-411f-b9e6-126bb4719ef3 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:10.481187 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 159/326] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jul 26 15:25:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:10.484095 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4aac28-a813-478d-a24b-2367ca684681 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:10.617882 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4aac28-a813-478d-a24b-2367ca684681 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:10.659355 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:10.662846 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9c8479-835c-4ba0-80bd-07248098a424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:10.663601 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c8479-835c-4ba0-80bd-07248098a424 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:10.663866 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c8479-835c-4ba0-80bd-07248098a424 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:10.664162 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c8479-835c-4ba0-80bd-07248098a424 None admin] PATH_INFO: `/v3/users/2adf77bba1d84cabb15b4fbea747cdb8` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:10.665571 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9c8479-835c-4ba0-80bd-07248098a424 None admin] RBAC: Authorizing `identity:get_user(user_id=2adf77bba1d84cabb15b4fbea747cdb8)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:10.667161 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9c8479-835c-4ba0-80bd-07248098a424 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:10.669498 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 168/327] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 26 15:25:10 2022] GET /identity/v3/users/2adf77bba1d84cabb15b4fbea747cdb8 => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:10.676060 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4f0c2d-4b75-411f-b9e6-126bb4719ef3 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:10.727663 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:10.804344 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4f0c2d-4b75-411f-b9e6-126bb4719ef3 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:10.852053 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939e5040-bddf-40ce-894b-d60f6bb9f18a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:10.852710 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e5040-bddf-40ce-894b-d60f6bb9f18a None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:10.852984 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e5040-bddf-40ce-894b-d60f6bb9f18a None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:10.853267 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e5040-bddf-40ce-894b-d60f6bb9f18a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:10.854087 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939e5040-bddf-40ce-894b-d60f6bb9f18a None admin] RBAC: Adding query filter params (role.id=fd8f80bccab248edbb1d09ec187a8113, user.id=2adf77bba1d84cabb15b4fbea747cdb8, scope.system=all) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:10.854400 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939e5040-bddf-40ce-894b-d60f6bb9f18a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:10.855930 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939e5040-bddf-40ce-894b-d60f6bb9f18a None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:10.869397 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 160/328] 10.222.0.18 () {56 vars in 1308 bytes} [Tue Jul 26 15:25:10 2022] GET /identity/v3/role_assignments?user.id=2adf77bba1d84cabb15b4fbea747cdb8&scope.system=all&role.id=fd8f80bccab248edbb1d09ec187a8113 => generated 510 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:10.882123 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ef538-4808-414f-872a-264c9a4dfe49 None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:10.882517 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ef538-4808-414f-872a-264c9a4dfe49 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:10.882695 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ef538-4808-414f-872a-264c9a4dfe49 None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:10.884459 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 169/329] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:25:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:25:10.890632 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c3cf45-80d3-44bd-ae9d-5cceaceb6852 None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:10.890921 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c3cf45-80d3-44bd-ae9d-5cceaceb6852 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:10.891259 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c3cf45-80d3-44bd-ae9d-5cceaceb6852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:10.921972 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-e6c3cf45-80d3-44bd-ae9d-5cceaceb6852 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:25:10.923312 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-e6c3cf45-80d3-44bd-ae9d-5cceaceb6852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:25:11.016857 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 161/330] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:25:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 15:25:11.057526 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89ef538-4808-414f-872a-264c9a4dfe49 None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:11.309441 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89ef538-4808-414f-872a-264c9a4dfe49 None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:11.383365 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1a959b-1671-40d5-8247-aa2c0db6b886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:11.384934 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a959b-1671-40d5-8247-aa2c0db6b886 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:11.385705 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a959b-1671-40d5-8247-aa2c0db6b886 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:11.386465 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a959b-1671-40d5-8247-aa2c0db6b886 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:11.412701 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1a959b-1671-40d5-8247-aa2c0db6b886 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:25:11.433134 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-2e1a959b-1671-40d5-8247-aa2c0db6b886 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 15:25:11.433134 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:25:11.433134 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:25:11.433134 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:25:11.433134 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:25:11.433134 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:25:11.433134 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:25:11.433134 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:25:11.433134 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:25:11.433134 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:25:11.433134 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:25:11.433134 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:25:11.433134 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:25:11.433134 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:25:11.433134 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:25:11.433134 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:25:11.434861 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:25:11.434861 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:25:11.434861 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:25:11.434861 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:25:11.434861 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:25:11.434861 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:25:11.434861 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:25:11.434861 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:25:11.434861 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:25:11.434861 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:25:11.434861 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:25:11.434861 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:25:11.434861 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:25:11.434861 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:25:11.434861 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:25:11.434861 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:25:11.437102 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:25:11.437102 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:25:11.437102 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:25:11.437102 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:25:11.437102 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:25:11.437102 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:25:11.437102 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:25:11.437102 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:25:11.437102 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:25:11.437102 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:25:11.437102 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 15:25:11.437102 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:25:11.442813 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 170/331] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 15:25:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 386 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:25:11.450320 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c3cf45-80d3-44bd-ae9d-5cceaceb6852 None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:11.495675 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:11.586150 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c3cf45-80d3-44bd-ae9d-5cceaceb6852 None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:11.632551 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9a3488-14ad-41b0-96bf-a68cbd3ba821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:11.633204 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9a3488-14ad-41b0-96bf-a68cbd3ba821 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:11.633487 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9a3488-14ad-41b0-96bf-a68cbd3ba821 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:11.633759 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9a3488-14ad-41b0-96bf-a68cbd3ba821 None admin] PATH_INFO: `/v3/roles` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:11.634565 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9a3488-14ad-41b0-96bf-a68cbd3ba821 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:11.634877 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9a3488-14ad-41b0-96bf-a68cbd3ba821 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:11.636337 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9a3488-14ad-41b0-96bf-a68cbd3ba821 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:11.647105 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 162/332] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jul 26 15:25:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:11.656787 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1a959b-1671-40d5-8247-aa2c0db6b886 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:11.818006 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:11.910311 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1a959b-1671-40d5-8247-aa2c0db6b886 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:11.950228 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f09575-187c-4af4-98cb-7f3b0b72e230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:11.951038 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f09575-187c-4af4-98cb-7f3b0b72e230 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:11.951353 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f09575-187c-4af4-98cb-7f3b0b72e230 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:11.951616 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f09575-187c-4af4-98cb-7f3b0b72e230 None admin] PATH_INFO: `/v3/users/a6c57fd2eccf4745af0f9956cdae2ae2` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:11.956094 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f09575-187c-4af4-98cb-7f3b0b72e230 None admin] RBAC: Authorizing `identity:get_user(user_id=a6c57fd2eccf4745af0f9956cdae2ae2)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:11.957654 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f09575-187c-4af4-98cb-7f3b0b72e230 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:11.959867 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 171/333] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 26 15:25:11 2022] GET /identity/v3/users/a6c57fd2eccf4745af0f9956cdae2ae2 => generated 293 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:11.966007 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9a3488-14ad-41b0-96bf-a68cbd3ba821 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:12.110045 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:12.127605 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9a3488-14ad-41b0-96bf-a68cbd3ba821 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:12.167487 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b11310-e7c3-42c7-93ba-2666df264148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:12.168069 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b11310-e7c3-42c7-93ba-2666df264148 None admin] REQUEST_METHOD: `PUT` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:12.168380 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b11310-e7c3-42c7-93ba-2666df264148 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:12.168659 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b11310-e7c3-42c7-93ba-2666df264148 None admin] PATH_INFO: `/v3/system/users/a6c57fd2eccf4745af0f9956cdae2ae2/roles/c692edefa26c417c8d43da5d89ec8462` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:12.176062 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b11310-e7c3-42c7-93ba-2666df264148 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a6c57fd2eccf4745af0f9956cdae2ae2, role_id=c692edefa26c417c8d43da5d89ec8462)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:12.177526 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b11310-e7c3-42c7-93ba-2666df264148 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:12.254105 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 163/334] 10.222.0.18 () {58 vars in 1334 bytes} [Tue Jul 26 15:25:11 2022] PUT /identity/v3/system/users/a6c57fd2eccf4745af0f9956cdae2ae2/roles/c692edefa26c417c8d43da5d89ec8462 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:25:13.999527 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddca136-48a1-43f8-abea-6200ceedb1fd None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:14.000903 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddca136-48a1-43f8-abea-6200ceedb1fd None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:14.001619 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddca136-48a1-43f8-abea-6200ceedb1fd None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:14.004850 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 172/335] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:25:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:25:14.015514 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d613b7-4685-45a2-8daf-de099c6095af None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:14.016891 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d613b7-4685-45a2-8daf-de099c6095af None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:14.017597 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d613b7-4685-45a2-8daf-de099c6095af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:14.058456 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-01d613b7-4685-45a2-8daf-de099c6095af None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:25:14.060837 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-01d613b7-4685-45a2-8daf-de099c6095af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:25:14.225280 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 164/336] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:25:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 15:25:14.300102 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddca136-48a1-43f8-abea-6200ceedb1fd None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:14.519409 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8fe88b-34ce-488e-a442-1ac5f99c1f66 None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:14.520094 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8fe88b-34ce-488e-a442-1ac5f99c1f66 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:14.520628 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8fe88b-34ce-488e-a442-1ac5f99c1f66 None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:14.522682 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 165/337] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:25:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:25:14.528804 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b1a818-959e-426c-af91-dcddf26430ec None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:14.530282 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b1a818-959e-426c-af91-dcddf26430ec None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:14.530849 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b1a818-959e-426c-af91-dcddf26430ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:14.532494 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddca136-48a1-43f8-abea-6200ceedb1fd None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:14.567912 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-50b1a818-959e-426c-af91-dcddf26430ec None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:25:14.569684 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-50b1a818-959e-426c-af91-dcddf26430ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:25:14.600166 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:14.624303 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4219ed3f-5a8e-49fc-8965-2dba9f599b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:14.625424 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4219ed3f-5a8e-49fc-8965-2dba9f599b28 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:14.625931 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4219ed3f-5a8e-49fc-8965-2dba9f599b28 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:14.626543 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4219ed3f-5a8e-49fc-8965-2dba9f599b28 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:14.660119 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4219ed3f-5a8e-49fc-8965-2dba9f599b28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:25:14.674715 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-4219ed3f-5a8e-49fc-8965-2dba9f599b28 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 15:25:14.674715 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:25:14.674715 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:25:14.674715 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:25:14.674715 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:25:14.674715 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:25:14.674715 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:25:14.674715 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:25:14.674715 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:25:14.674715 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:25:14.674715 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:25:14.674715 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:25:14.674715 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:25:14.674715 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:25:14.674715 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:25:14.674715 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:25:14.676599 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:25:14.676599 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:25:14.676599 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:25:14.676599 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:25:14.676599 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:25:14.676599 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:25:14.676599 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:25:14.676599 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:25:14.676599 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:25:14.676599 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:25:14.676599 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:25:14.676599 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:25:14.676599 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:25:14.676599 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:25:14.676599 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:25:14.676599 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:25:14.678129 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:25:14.678129 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:25:14.678129 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:25:14.678129 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:25:14.678129 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:25:14.678129 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:25:14.678129 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:25:14.678129 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:25:14.678129 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:25:14.678129 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:25:14.678129 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 15:25:14.678129 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:25:14.678129 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 173/338] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 15:25:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 378 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:25:14.687572 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4219ed3f-5a8e-49fc-8965-2dba9f599b28 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:14.743288 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 166/339] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:25:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 15:25:14.784484 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b1a818-959e-426c-af91-dcddf26430ec None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:14.822528 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:14.948000 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4219ed3f-5a8e-49fc-8965-2dba9f599b28 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:15.014901 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b1a818-959e-426c-af91-dcddf26430ec None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:15.024687 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30a4d74-f7cc-4325-b624-bf48ae8a0338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:15.025705 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a4d74-f7cc-4325-b624-bf48ae8a0338 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:15.026199 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a4d74-f7cc-4325-b624-bf48ae8a0338 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:15.026692 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a4d74-f7cc-4325-b624-bf48ae8a0338 None admin] PATH_INFO: `/v3/roles` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:15.028194 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30a4d74-f7cc-4325-b624-bf48ae8a0338 None admin] RBAC: Adding query filter params (name=member) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:15.029326 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30a4d74-f7cc-4325-b624-bf48ae8a0338 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:15.032085 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30a4d74-f7cc-4325-b624-bf48ae8a0338 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:15.055522 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 174/340] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jul 26 15:25:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:15.058668 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e46e2a-44d5-4080-8568-048385f01677 None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:15.059179 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e46e2a-44d5-4080-8568-048385f01677 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:15.059673 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e46e2a-44d5-4080-8568-048385f01677 None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:15.066532 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b868e9b1-7029-4b0d-b644-9962f2924e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:15.067761 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b868e9b1-7029-4b0d-b644-9962f2924e7c None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:15.067761 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b868e9b1-7029-4b0d-b644-9962f2924e7c None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:15.067761 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b868e9b1-7029-4b0d-b644-9962f2924e7c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:15.068686 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 175/341] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:25:15 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:25:15.070176 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e46e2a-44d5-4080-8568-048385f01677 None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:15.081940 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b868e9b1-7029-4b0d-b644-9962f2924e7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:25:15.086977 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application [None req-b868e9b1-7029-4b0d-b644-9962f2924e7c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 15:25:15.086977 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:25:15.086977 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:25:15.086977 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:25:15.086977 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:25:15.086977 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:25:15.086977 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:25:15.086977 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:25:15.086977 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:25:15.086977 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:25:15.086977 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:25:15.086977 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:25:15.086977 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:25:15.086977 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:25:15.086977 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:25:15.086977 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:25:15.090393 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:25:15.090393 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:25:15.090393 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:25:15.090393 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:25:15.090393 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:25:15.090393 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:25:15.090393 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:25:15.090393 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:25:15.090393 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:25:15.090393 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:25:15.090393 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:25:15.090393 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application with Lock( Jul 26 15:25:15.090393 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:25:15.090393 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:25:15.090393 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:25:15.090393 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:25:15.094093 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:25:15.094093 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:25:15.094093 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:25:15.094093 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:25:15.094093 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:25:15.094093 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:25:15.094093 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:25:15.094093 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:25:15.094093 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:25:15.094093 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:25:15.094093 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 15:25:15.094093 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:25:15.094093 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 167/342] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jul 26 15:25:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 15:25:15.100450 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b868e9b1-7029-4b0d-b644-9962f2924e7c None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:15.179796 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:15.189617 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:15.242260 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b868e9b1-7029-4b0d-b644-9962f2924e7c None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:15.262494 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e46e2a-44d5-4080-8568-048385f01677 None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:15.315081 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6961fe2a-3fdb-4c43-b380-cb744140a396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:15.315991 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6961fe2a-3fdb-4c43-b380-cb744140a396 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:15.316435 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6961fe2a-3fdb-4c43-b380-cb744140a396 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:15.316860 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6961fe2a-3fdb-4c43-b380-cb744140a396 None admin] PATH_INFO: `/v3/roles` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:15.318055 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6961fe2a-3fdb-4c43-b380-cb744140a396 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:15.318535 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6961fe2a-3fdb-4c43-b380-cb744140a396 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:15.321001 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6961fe2a-3fdb-4c43-b380-cb744140a396 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:15.359385 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 168/343] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 15:25:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:15.365677 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e0675-463b-4830-88a7-53f1c018ec49 None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:15.366148 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e0675-463b-4830-88a7-53f1c018ec49 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:15.366587 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e0675-463b-4830-88a7-53f1c018ec49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:15.376471 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54222fbd-8844-46c7-ae4e-5ae5a12add31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:15.377428 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54222fbd-8844-46c7-ae4e-5ae5a12add31 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:15.377853 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54222fbd-8844-46c7-ae4e-5ae5a12add31 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:15.378269 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54222fbd-8844-46c7-ae4e-5ae5a12add31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:15.427829 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-080e0675-463b-4830-88a7-53f1c018ec49 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:25:15.429115 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-080e0675-463b-4830-88a7-53f1c018ec49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:25:15.535256 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 169/344] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:25:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:25:15.536161 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e0675-463b-4830-88a7-53f1c018ec49 None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:15.588817 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54222fbd-8844-46c7-ae4e-5ae5a12add31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:15.590277 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54222fbd-8844-46c7-ae4e-5ae5a12add31 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:15.673150 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:15.695114 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:15.779804 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e0675-463b-4830-88a7-53f1c018ec49 None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:15.807100 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 176/345] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 15:25:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 738 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 15:25:15.807828 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54222fbd-8844-46c7-ae4e-5ae5a12add31 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:15.865358 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0212f6d-125e-499f-8484-b4e72a3f7509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:15.866803 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0212f6d-125e-499f-8484-b4e72a3f7509 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:15.866803 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0212f6d-125e-499f-8484-b4e72a3f7509 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:15.866803 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0212f6d-125e-499f-8484-b4e72a3f7509 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:15.958433 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54222fbd-8844-46c7-ae4e-5ae5a12add31 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:15.964457 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0212f6d-125e-499f-8484-b4e72a3f7509 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:15.966463 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0212f6d-125e-499f-8484-b4e72a3f7509 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:16.018394 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d1d81b-ecce-47ac-a6bf-fb46fc732bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:16.018635 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d1d81b-ecce-47ac-a6bf-fb46fc732bef None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:16.018869 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d1d81b-ecce-47ac-a6bf-fb46fc732bef None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:16.019185 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d1d81b-ecce-47ac-a6bf-fb46fc732bef None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:16.037588 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d1d81b-ecce-47ac-a6bf-fb46fc732bef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:25:16.046065 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-87d1d81b-ecce-47ac-a6bf-fb46fc732bef None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 15:25:16.046065 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:25:16.046065 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:25:16.046065 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:25:16.046065 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:25:16.046065 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:25:16.046065 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:25:16.046065 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:25:16.046065 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:25:16.046065 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:25:16.046065 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:25:16.046065 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:25:16.046065 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:25:16.046065 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:25:16.046065 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:25:16.046065 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:25:16.047113 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:25:16.047113 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:25:16.047113 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:25:16.047113 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:25:16.047113 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:25:16.047113 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:25:16.047113 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:25:16.047113 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:25:16.047113 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:25:16.047113 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:25:16.047113 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:25:16.047113 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:25:16.047113 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:25:16.047113 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:25:16.047113 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:25:16.047113 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:25:16.047984 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:25:16.047984 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:25:16.047984 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:25:16.047984 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:25:16.047984 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:25:16.047984 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:25:16.047984 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:25:16.047984 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:25:16.047984 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:25:16.047984 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:25:16.047984 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 15:25:16.047984 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:25:16.049200 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 177/346] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jul 26 15:25:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:25:16.054616 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d1d81b-ecce-47ac-a6bf-fb46fc732bef None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:16.068591 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:16.079932 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:16.161515 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 170/347] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 15:25:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 625 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 15:25:16.164383 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161a6b7-a86b-4fee-b872-dee3309c38cb None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:16.165240 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161a6b7-a86b-4fee-b872-dee3309c38cb None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:16.165837 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161a6b7-a86b-4fee-b872-dee3309c38cb None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:16.168565 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 171/348] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:25:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:25:16.175414 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c83d0-9e30-4b2f-93fc-e6cbe7bd5965 None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:16.175967 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c83d0-9e30-4b2f-93fc-e6cbe7bd5965 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:16.176446 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c83d0-9e30-4b2f-93fc-e6cbe7bd5965 None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:16.178012 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 172/349] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:25:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:25:16.178952 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393c83d0-9e30-4b2f-93fc-e6cbe7bd5965 None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:16.233420 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d1d81b-ecce-47ac-a6bf-fb46fc732bef None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:16.283858 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d396905d-80c9-4dd4-a6be-d1f0dac25156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:16.284992 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d396905d-80c9-4dd4-a6be-d1f0dac25156 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:16.285469 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d396905d-80c9-4dd4-a6be-d1f0dac25156 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:16.285951 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d396905d-80c9-4dd4-a6be-d1f0dac25156 None admin] PATH_INFO: `/v3/projects/e99ebc2f1eb141dc8c8555d0aea0cd1f` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:16.288073 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d396905d-80c9-4dd4-a6be-d1f0dac25156 None admin] RBAC: Authorizing `identity:get_project(project_id=e99ebc2f1eb141dc8c8555d0aea0cd1f)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:16.290805 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d396905d-80c9-4dd4-a6be-d1f0dac25156 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:16.294780 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 178/350] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 15:25:16 2022] GET /identity/v3/projects/e99ebc2f1eb141dc8c8555d0aea0cd1f => generated 298 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:16.296317 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d396905d-80c9-4dd4-a6be-d1f0dac25156 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:16.338289 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393c83d0-9e30-4b2f-93fc-e6cbe7bd5965 None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:16.392317 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed43986-7add-46f7-9fe4-cfd786e435d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:16.392955 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed43986-7add-46f7-9fe4-cfd786e435d7 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:16.393271 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed43986-7add-46f7-9fe4-cfd786e435d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:16.393551 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed43986-7add-46f7-9fe4-cfd786e435d7 None admin] PATH_INFO: `/v3/roles` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:16.394311 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed43986-7add-46f7-9fe4-cfd786e435d7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:16.394728 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed43986-7add-46f7-9fe4-cfd786e435d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:16.396105 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed43986-7add-46f7-9fe4-cfd786e435d7 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:16.408014 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 173/351] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 15:25:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:16.410393 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7941a-c8e0-4fdb-963c-39f1ca8e33da None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:16.410973 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7941a-c8e0-4fdb-963c-39f1ca8e33da None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:16.411611 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7941a-c8e0-4fdb-963c-39f1ca8e33da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:16.435013 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:16.450031 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-d1c7941a-c8e0-4fdb-963c-39f1ca8e33da None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:25:16.451605 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-d1c7941a-c8e0-4fdb-963c-39f1ca8e33da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:25:16.470569 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d396905d-80c9-4dd4-a6be-d1f0dac25156 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:16.498321 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:16.528437 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4c67ec-e540-4db8-b85d-e265b0f979f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:16.530139 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4c67ec-e540-4db8-b85d-e265b0f979f9 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:16.530454 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4c67ec-e540-4db8-b85d-e265b0f979f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:16.530776 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4c67ec-e540-4db8-b85d-e265b0f979f9 None admin] PATH_INFO: `/v3/projects/e99ebc2f1eb141dc8c8555d0aea0cd1f` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:16.533266 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4c67ec-e540-4db8-b85d-e265b0f979f9 None admin] RBAC: Authorizing `identity:get_project(project_id=e99ebc2f1eb141dc8c8555d0aea0cd1f)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:16.534807 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4c67ec-e540-4db8-b85d-e265b0f979f9 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:16.537030 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 179/352] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 15:25:16 2022] GET /identity/v3/projects/e99ebc2f1eb141dc8c8555d0aea0cd1f => generated 298 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:16.538404 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691d573d-3f94-431c-880b-d2ffce4d2b0b None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:16.538722 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691d573d-3f94-431c-880b-d2ffce4d2b0b None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:16.538966 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691d573d-3f94-431c-880b-d2ffce4d2b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:16.565703 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-691d573d-3f94-431c-880b-d2ffce4d2b0b None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:25:16.566942 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-691d573d-3f94-431c-880b-d2ffce4d2b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:25:16.580831 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 174/353] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:25:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:25:16.583614 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174ac41a-6d5d-4632-9e2e-b326897c5ca5 None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:16.584746 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174ac41a-6d5d-4632-9e2e-b326897c5ca5 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:16.585254 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174ac41a-6d5d-4632-9e2e-b326897c5ca5 None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:16.588689 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 175/354] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:25:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:25:16.590428 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174ac41a-6d5d-4632-9e2e-b326897c5ca5 None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:16.686015 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 180/355] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:25:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:25:16.687512 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691d573d-3f94-431c-880b-d2ffce4d2b0b None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:16.760852 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174ac41a-6d5d-4632-9e2e-b326897c5ca5 None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:16.823078 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139e507d-cb2b-4841-a815-d4d7b6f9c38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:16.824388 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e507d-cb2b-4841-a815-d4d7b6f9c38a None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:16.824892 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e507d-cb2b-4841-a815-d4d7b6f9c38a None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:16.825362 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e507d-cb2b-4841-a815-d4d7b6f9c38a None admin] PATH_INFO: `/v3/groups/5cdf3be8fcaa4c96b6acbc1e74944a30` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:16.835987 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139e507d-cb2b-4841-a815-d4d7b6f9c38a None admin] RBAC: Authorizing `identity:get_group(group_id=5cdf3be8fcaa4c96b6acbc1e74944a30)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:16.836225 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:16.838064 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139e507d-cb2b-4841-a815-d4d7b6f9c38a None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:16.840769 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 176/356] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Jul 26 15:25:16 2022] GET /identity/v3/groups/5cdf3be8fcaa4c96b6acbc1e74944a30 => generated 226 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:16.842341 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139e507d-cb2b-4841-a815-d4d7b6f9c38a None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:16.873478 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691d573d-3f94-431c-880b-d2ffce4d2b0b None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:16.886907 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:16.946531 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f38e19-f590-443b-acc4-b475a7f71646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:16.947487 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f38e19-f590-443b-acc4-b475a7f71646 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:16.947997 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f38e19-f590-443b-acc4-b475a7f71646 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:16.948479 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f38e19-f590-443b-acc4-b475a7f71646 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:17.038447 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139e507d-cb2b-4841-a815-d4d7b6f9c38a None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:17.094105 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f38e19-f590-443b-acc4-b475a7f71646 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:17.096753 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f38e19-f590-443b-acc4-b475a7f71646 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:17.101417 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8c0b83-379a-4134-bb8c-6c698e819c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:17.102934 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c0b83-379a-4134-bb8c-6c698e819c9a None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:17.102934 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c0b83-379a-4134-bb8c-6c698e819c9a None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:17.104254 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c0b83-379a-4134-bb8c-6c698e819c9a None admin] PATH_INFO: `/v3/groups/5cdf3be8fcaa4c96b6acbc1e74944a30` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:17.105774 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8c0b83-379a-4134-bb8c-6c698e819c9a None admin] RBAC: Authorizing `identity:get_group(group_id=5cdf3be8fcaa4c96b6acbc1e74944a30)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:17.110729 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8c0b83-379a-4134-bb8c-6c698e819c9a None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:17.113770 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 177/357] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Jul 26 15:25:16 2022] GET /identity/v3/groups/5cdf3be8fcaa4c96b6acbc1e74944a30 => generated 226 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:17.114176 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca7775-b1d9-46ff-a515-321544d7d23f None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:17.114664 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca7775-b1d9-46ff-a515-321544d7d23f None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:17.115171 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca7775-b1d9-46ff-a515-321544d7d23f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:17.141745 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-edca7775-b1d9-46ff-a515-321544d7d23f None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:25:17.143887 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-edca7775-b1d9-46ff-a515-321544d7d23f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:25:17.230829 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:17.255368 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 178/358] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:25:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:25:17.256256 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edca7775-b1d9-46ff-a515-321544d7d23f None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:17.284381 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 181/359] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 15:25:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 598 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 15:25:17.285527 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f38e19-f590-443b-acc4-b475a7f71646 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:17.290890 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:17.438020 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edca7775-b1d9-46ff-a515-321544d7d23f None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:17.449501 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f38e19-f590-443b-acc4-b475a7f71646 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:17.474740 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff7069f-9c51-4275-9b6f-bc2b4d0ee5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:17.475426 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff7069f-9c51-4275-9b6f-bc2b4d0ee5b9 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:17.475744 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff7069f-9c51-4275-9b6f-bc2b4d0ee5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:17.475976 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff7069f-9c51-4275-9b6f-bc2b4d0ee5b9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:17.488035 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff7069f-9c51-4275-9b6f-bc2b4d0ee5b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:25:17.494278 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application [None req-6ff7069f-9c51-4275-9b6f-bc2b4d0ee5b9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 15:25:17.494278 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:25:17.494278 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:25:17.494278 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:25:17.494278 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:25:17.494278 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:25:17.494278 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:25:17.494278 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:25:17.494278 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:25:17.494278 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:25:17.494278 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:25:17.494278 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:25:17.494278 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:25:17.494278 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:25:17.494278 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:25:17.494278 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:25:17.495391 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:25:17.495391 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:25:17.495391 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:25:17.495391 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:25:17.495391 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:25:17.495391 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:25:17.495391 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:25:17.495391 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:25:17.495391 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:25:17.495391 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:25:17.495391 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:25:17.495391 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application with Lock( Jul 26 15:25:17.495391 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:25:17.495391 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:25:17.495391 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:25:17.495391 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:25:17.496396 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:25:17.496396 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:25:17.496396 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:25:17.496396 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:25:17.496396 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:25:17.496396 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:25:17.496396 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:25:17.496396 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:25:17.496396 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:25:17.496396 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:25:17.496396 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 15:25:17.496396 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:25:17.496396 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 179/360] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 15:25:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:25:17.496396 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff7069f-9c51-4275-9b6f-bc2b4d0ee5b9 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:17.508858 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144b7b3d-d5ea-41d2-8bad-92f57c568a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:17.512536 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b7b3d-d5ea-41d2-8bad-92f57c568a84 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:17.512536 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b7b3d-d5ea-41d2-8bad-92f57c568a84 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:17.512536 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b7b3d-d5ea-41d2-8bad-92f57c568a84 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:17.523332 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144b7b3d-d5ea-41d2-8bad-92f57c568a84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:25:17.528769 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-144b7b3d-d5ea-41d2-8bad-92f57c568a84 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 15:25:17.528769 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:25:17.528769 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:25:17.528769 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:25:17.528769 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:25:17.528769 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:25:17.528769 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:25:17.528769 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:25:17.528769 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:25:17.528769 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:25:17.528769 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:25:17.528769 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:25:17.528769 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:25:17.528769 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:25:17.528769 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:25:17.528769 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:25:17.530334 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:25:17.530334 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:25:17.530334 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:25:17.530334 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:25:17.530334 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:25:17.530334 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:25:17.530334 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:25:17.530334 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:25:17.530334 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:25:17.530334 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:25:17.530334 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:25:17.530334 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:25:17.530334 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:25:17.530334 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:25:17.530334 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:25:17.530334 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:25:17.531741 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:25:17.531741 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:25:17.531741 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:25:17.531741 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:25:17.531741 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:25:17.531741 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:25:17.531741 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:25:17.531741 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:25:17.531741 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:25:17.531741 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:25:17.531741 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 15:25:17.531741 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:25:17.531741 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 182/361] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jul 26 15:25:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:25:17.531741 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144b7b3d-d5ea-41d2-8bad-92f57c568a84 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:17.584669 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:17.613162 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:17.637023 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff7069f-9c51-4275-9b6f-bc2b4d0ee5b9 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:17.673711 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144b7b3d-d5ea-41d2-8bad-92f57c568a84 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:17.694424 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cec6953-99ff-40ab-86ba-3deedb644432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:17.695083 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cec6953-99ff-40ab-86ba-3deedb644432 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:17.695423 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cec6953-99ff-40ab-86ba-3deedb644432 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:17.695703 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cec6953-99ff-40ab-86ba-3deedb644432 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:17.696536 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cec6953-99ff-40ab-86ba-3deedb644432 None admin] RBAC: Adding query filter params (group.id=5cdf3be8fcaa4c96b6acbc1e74944a30, role.id=fd8f80bccab248edbb1d09ec187a8113, scope.project.id=e99ebc2f1eb141dc8c8555d0aea0cd1f) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:17.696850 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cec6953-99ff-40ab-86ba-3deedb644432 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:17.698385 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cec6953-99ff-40ab-86ba-3deedb644432 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:17.705758 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 180/362] 10.222.0.18 () {56 vars in 1376 bytes} [Tue Jul 26 15:25:17 2022] GET /identity/v3/role_assignments?group.id=5cdf3be8fcaa4c96b6acbc1e74944a30&scope.project.id=e99ebc2f1eb141dc8c8555d0aea0cd1f&role.id=fd8f80bccab248edbb1d09ec187a8113 => generated 260 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:17.706656 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cec6953-99ff-40ab-86ba-3deedb644432 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:17.741855 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a26c03-f2bf-4489-9bee-7407dea211fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:17.742428 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a26c03-f2bf-4489-9bee-7407dea211fd None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:17.742725 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a26c03-f2bf-4489-9bee-7407dea211fd None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:17.743007 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a26c03-f2bf-4489-9bee-7407dea211fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:17.743918 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a26c03-f2bf-4489-9bee-7407dea211fd None admin] RBAC: Adding query filter params (group.id=5cdf3be8fcaa4c96b6acbc1e74944a30, role.id=c86cdde38565431ebacf53dcfc4d863b, scope.project.id=e99ebc2f1eb141dc8c8555d0aea0cd1f) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:17.744266 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a26c03-f2bf-4489-9bee-7407dea211fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:17.745968 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a26c03-f2bf-4489-9bee-7407dea211fd None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:17.754395 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 183/363] 10.222.0.18 () {56 vars in 1376 bytes} [Tue Jul 26 15:25:17 2022] GET /identity/v3/role_assignments?group.id=5cdf3be8fcaa4c96b6acbc1e74944a30&scope.project.id=e99ebc2f1eb141dc8c8555d0aea0cd1f&role.id=c86cdde38565431ebacf53dcfc4d863b => generated 260 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:17.755209 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a26c03-f2bf-4489-9bee-7407dea211fd None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:17.892340 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cec6953-99ff-40ab-86ba-3deedb644432 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:17.956781 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eed7b5a-fed5-4a6f-ae61-83e09c6644af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:17.958214 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed7b5a-fed5-4a6f-ae61-83e09c6644af None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:17.958852 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed7b5a-fed5-4a6f-ae61-83e09c6644af None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:17.959517 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed7b5a-fed5-4a6f-ae61-83e09c6644af None admin] PATH_INFO: `/v3/projects/24c3fa325d8a41dc8ac86599b7fb5180` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:17.963612 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eed7b5a-fed5-4a6f-ae61-83e09c6644af None admin] RBAC: Authorizing `identity:get_project(project_id=24c3fa325d8a41dc8ac86599b7fb5180)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:17.969625 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eed7b5a-fed5-4a6f-ae61-83e09c6644af None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:17.975528 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 181/364] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 15:25:17 2022] GET /identity/v3/projects/24c3fa325d8a41dc8ac86599b7fb5180 => generated 302 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:17.979929 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eed7b5a-fed5-4a6f-ae61-83e09c6644af None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:17.980152 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a26c03-f2bf-4489-9bee-7407dea211fd None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:17.984876 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:18.005627 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:18.037588 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019458fa-e1ca-4b26-852a-e7135bb621a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:18.039768 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019458fa-e1ca-4b26-852a-e7135bb621a1 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:18.040311 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019458fa-e1ca-4b26-852a-e7135bb621a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:18.040731 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019458fa-e1ca-4b26-852a-e7135bb621a1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:18.058691 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019458fa-e1ca-4b26-852a-e7135bb621a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:25:18.067340 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-019458fa-e1ca-4b26-852a-e7135bb621a1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 15:25:18.067340 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:25:18.067340 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:25:18.067340 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:25:18.067340 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:25:18.067340 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:25:18.067340 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:25:18.067340 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:25:18.067340 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:25:18.067340 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:25:18.067340 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:25:18.067340 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:25:18.067340 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:25:18.067340 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:25:18.067340 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:25:18.067340 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:25:18.068483 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:25:18.068483 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:25:18.068483 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:25:18.068483 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:25:18.068483 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:25:18.068483 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:25:18.068483 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:25:18.068483 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:25:18.068483 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:25:18.068483 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:25:18.068483 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:25:18.068483 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:25:18.068483 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:25:18.068483 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:25:18.068483 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:25:18.068483 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:25:18.069463 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:25:18.069463 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:25:18.069463 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:25:18.069463 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:25:18.069463 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:25:18.069463 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:25:18.069463 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:25:18.069463 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:25:18.069463 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:25:18.069463 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:25:18.069463 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 15:25:18.069463 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:25:18.072513 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 184/365] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 15:25:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:25:18.073847 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019458fa-e1ca-4b26-852a-e7135bb621a1 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:18.124255 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eed7b5a-fed5-4a6f-ae61-83e09c6644af None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:18.167485 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8302f78-9dc0-4750-99ed-c9105b3a97fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:18.168334 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8302f78-9dc0-4750-99ed-c9105b3a97fc None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:18.169005 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8302f78-9dc0-4750-99ed-c9105b3a97fc None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:18.170001 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8302f78-9dc0-4750-99ed-c9105b3a97fc None admin] PATH_INFO: `/v3/roles` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:18.170991 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8302f78-9dc0-4750-99ed-c9105b3a97fc None admin] RBAC: Adding query filter params (name=member) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:18.171428 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8302f78-9dc0-4750-99ed-c9105b3a97fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:18.173159 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8302f78-9dc0-4750-99ed-c9105b3a97fc None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:18.189564 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 182/366] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jul 26 15:25:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:18.189564 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8302f78-9dc0-4750-99ed-c9105b3a97fc None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:18.219100 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019458fa-e1ca-4b26-852a-e7135bb621a1 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:18.260216 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1a969c-7f19-4d5a-95ea-a5a113119ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:18.261202 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a969c-7f19-4d5a-95ea-a5a113119ef5 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:18.261796 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a969c-7f19-4d5a-95ea-a5a113119ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:18.262272 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a969c-7f19-4d5a-95ea-a5a113119ef5 None admin] PATH_INFO: `/v3/roles` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:18.263827 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1a969c-7f19-4d5a-95ea-a5a113119ef5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:18.264356 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1a969c-7f19-4d5a-95ea-a5a113119ef5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:18.266259 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1a969c-7f19-4d5a-95ea-a5a113119ef5 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:18.276059 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:18.278280 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 185/367] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 15:25:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:18.280051 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1a969c-7f19-4d5a-95ea-a5a113119ef5 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:18.310248 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:18.315625 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8302f78-9dc0-4750-99ed-c9105b3a97fc None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:18.362522 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eef1c0-77fe-4b25-8acf-1325176b1213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:18.363399 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eef1c0-77fe-4b25-8acf-1325176b1213 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:18.363753 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eef1c0-77fe-4b25-8acf-1325176b1213 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:18.364105 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eef1c0-77fe-4b25-8acf-1325176b1213 None admin] PATH_INFO: `/v3/groups/5cdf3be8fcaa4c96b6acbc1e74944a30` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:18.365659 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eef1c0-77fe-4b25-8acf-1325176b1213 None admin] RBAC: Authorizing `identity:get_group(group_id=5cdf3be8fcaa4c96b6acbc1e74944a30)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:18.367453 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eef1c0-77fe-4b25-8acf-1325176b1213 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:18.369377 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 183/368] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Jul 26 15:25:18 2022] GET /identity/v3/groups/5cdf3be8fcaa4c96b6acbc1e74944a30 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:18.376289 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eef1c0-77fe-4b25-8acf-1325176b1213 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:18.411884 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1a969c-7f19-4d5a-95ea-a5a113119ef5 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:18.455361 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093a6ee1-c8f3-4f38-8b34-25f2502e64d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:18.456309 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a6ee1-c8f3-4f38-8b34-25f2502e64d7 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:18.456771 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a6ee1-c8f3-4f38-8b34-25f2502e64d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:18.457240 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a6ee1-c8f3-4f38-8b34-25f2502e64d7 None admin] PATH_INFO: `/v3/roles` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:18.458302 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093a6ee1-c8f3-4f38-8b34-25f2502e64d7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:18.458810 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093a6ee1-c8f3-4f38-8b34-25f2502e64d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:18.460579 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093a6ee1-c8f3-4f38-8b34-25f2502e64d7 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:18.471518 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 186/369] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jul 26 15:25:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:18.472879 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093a6ee1-c8f3-4f38-8b34-25f2502e64d7 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:18.501635 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eef1c0-77fe-4b25-8acf-1325176b1213 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:18.543344 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6f8195-3ee8-4477-b527-7776764235a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:18.544148 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f8195-3ee8-4477-b527-7776764235a0 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:18.544987 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f8195-3ee8-4477-b527-7776764235a0 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:18.545270 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f8195-3ee8-4477-b527-7776764235a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:18.558867 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:18.578477 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:18.602381 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093a6ee1-c8f3-4f38-8b34-25f2502e64d7 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:18.634373 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6f8195-3ee8-4477-b527-7776764235a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:18.636029 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6f8195-3ee8-4477-b527-7776764235a0 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:18.666800 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787f3a14-94ac-4f30-8909-58e5d3287f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:18.667847 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787f3a14-94ac-4f30-8909-58e5d3287f70 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:18.668485 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787f3a14-94ac-4f30-8909-58e5d3287f70 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:18.669951 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787f3a14-94ac-4f30-8909-58e5d3287f70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:18.782823 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 184/370] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 15:25:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 15:25:18.784885 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6f8195-3ee8-4477-b527-7776764235a0 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:18.791664 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787f3a14-94ac-4f30-8909-58e5d3287f70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:18.793212 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787f3a14-94ac-4f30-8909-58e5d3287f70 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:18.887900 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:18.917587 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:18.958618 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 187/371] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 15:25:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 15:25:18.960095 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787f3a14-94ac-4f30-8909-58e5d3287f70 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:19.034441 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6f8195-3ee8-4477-b527-7776764235a0 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:19.082014 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e7b84-7dc2-4998-b73e-9190ff359ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:19.082920 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e7b84-7dc2-4998-b73e-9190ff359ba2 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:19.083399 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e7b84-7dc2-4998-b73e-9190ff359ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:19.083853 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e7b84-7dc2-4998-b73e-9190ff359ba2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:19.084941 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8e7b84-7dc2-4998-b73e-9190ff359ba2 None admin] RBAC: Adding query filter params (group.id=5cdf3be8fcaa4c96b6acbc1e74944a30, role.id=c86cdde38565431ebacf53dcfc4d863b, scope.project.id=24c3fa325d8a41dc8ac86599b7fb5180) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:19.085485 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8e7b84-7dc2-4998-b73e-9190ff359ba2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:19.087553 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8e7b84-7dc2-4998-b73e-9190ff359ba2 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:19.095697 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 185/372] 10.222.0.18 () {56 vars in 1376 bytes} [Tue Jul 26 15:25:18 2022] GET /identity/v3/role_assignments?group.id=5cdf3be8fcaa4c96b6acbc1e74944a30&scope.project.id=24c3fa325d8a41dc8ac86599b7fb5180&role.id=c86cdde38565431ebacf53dcfc4d863b => generated 260 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:19.097087 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e7b84-7dc2-4998-b73e-9190ff359ba2 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:19.161914 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787f3a14-94ac-4f30-8909-58e5d3287f70 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:19.207370 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d05a6c1-4d01-4ca7-8091-6879091d2907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:19.208406 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d05a6c1-4d01-4ca7-8091-6879091d2907 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:19.208959 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d05a6c1-4d01-4ca7-8091-6879091d2907 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:19.209534 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d05a6c1-4d01-4ca7-8091-6879091d2907 None admin] PATH_INFO: `/v3/users/a6c57fd2eccf4745af0f9956cdae2ae2` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:19.211231 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d05a6c1-4d01-4ca7-8091-6879091d2907 None admin] RBAC: Authorizing `identity:get_user(user_id=a6c57fd2eccf4745af0f9956cdae2ae2)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:19.213099 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d05a6c1-4d01-4ca7-8091-6879091d2907 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:19.215552 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 188/373] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 26 15:25:18 2022] GET /identity/v3/users/a6c57fd2eccf4745af0f9956cdae2ae2 => generated 293 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:19.217236 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d05a6c1-4d01-4ca7-8091-6879091d2907 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:19.311533 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e7b84-7dc2-4998-b73e-9190ff359ba2 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:19.329893 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:19.337770 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:19.355684 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0436dd93-a7f4-42fc-a100-2a36f1a423d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:19.357613 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0436dd93-a7f4-42fc-a100-2a36f1a423d5 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:19.358225 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0436dd93-a7f4-42fc-a100-2a36f1a423d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:19.358835 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0436dd93-a7f4-42fc-a100-2a36f1a423d5 None admin] PATH_INFO: `/v3/projects/24c3fa325d8a41dc8ac86599b7fb5180` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:19.360621 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0436dd93-a7f4-42fc-a100-2a36f1a423d5 None admin] RBAC: Authorizing `identity:get_project(project_id=24c3fa325d8a41dc8ac86599b7fb5180)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:19.363520 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0436dd93-a7f4-42fc-a100-2a36f1a423d5 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:19.366280 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 186/374] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 15:25:19 2022] GET /identity/v3/projects/24c3fa325d8a41dc8ac86599b7fb5180 => generated 302 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:19.367843 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0436dd93-a7f4-42fc-a100-2a36f1a423d5 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:19.490787 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0436dd93-a7f4-42fc-a100-2a36f1a423d5 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:19.521070 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d05a6c1-4d01-4ca7-8091-6879091d2907 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:19.530952 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c665645-fa86-4124-ba97-b8ed991b9b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:19.532154 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c665645-fa86-4124-ba97-b8ed991b9b5f None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:19.532702 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c665645-fa86-4124-ba97-b8ed991b9b5f None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:19.533186 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c665645-fa86-4124-ba97-b8ed991b9b5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:19.534187 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c665645-fa86-4124-ba97-b8ed991b9b5f None admin] RBAC: Adding query filter params (role.id=c692edefa26c417c8d43da5d89ec8462, user.id=a6c57fd2eccf4745af0f9956cdae2ae2, scope.system=all) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:19.534703 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c665645-fa86-4124-ba97-b8ed991b9b5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:19.536408 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c665645-fa86-4124-ba97-b8ed991b9b5f None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:19.553136 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 187/375] 10.222.0.18 () {56 vars in 1308 bytes} [Tue Jul 26 15:25:19 2022] GET /identity/v3/role_assignments?user.id=a6c57fd2eccf4745af0f9956cdae2ae2&scope.system=all&role.id=c692edefa26c417c8d43da5d89ec8462 => generated 510 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:19.554598 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c665645-fa86-4124-ba97-b8ed991b9b5f None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:19.591409 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:19.641460 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84aaea8-ddd5-4584-9dd6-114fda7998d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:19.642585 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84aaea8-ddd5-4584-9dd6-114fda7998d9 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:19.643083 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84aaea8-ddd5-4584-9dd6-114fda7998d9 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:19.643884 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84aaea8-ddd5-4584-9dd6-114fda7998d9 None admin] PATH_INFO: `/v3/projects/1316e00006b74e70a667f12420c63a2c` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:19.648804 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84aaea8-ddd5-4584-9dd6-114fda7998d9 None admin] RBAC: Authorizing `identity:get_project(project_id=1316e00006b74e70a667f12420c63a2c)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:19.651995 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84aaea8-ddd5-4584-9dd6-114fda7998d9 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:19.656138 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 189/376] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 15:25:19 2022] GET /identity/v3/projects/1316e00006b74e70a667f12420c63a2c => generated 344 bytes in 440 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:19.673864 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84aaea8-ddd5-4584-9dd6-114fda7998d9 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:19.679926 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c665645-fa86-4124-ba97-b8ed991b9b5f None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:19.721855 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b49a9c-6d09-4865-b545-9df0f215b0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:19.722837 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b49a9c-6d09-4865-b545-9df0f215b0f1 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:19.723333 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b49a9c-6d09-4865-b545-9df0f215b0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:19.723815 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b49a9c-6d09-4865-b545-9df0f215b0f1 None admin] PATH_INFO: `/v3/groups/5cdf3be8fcaa4c96b6acbc1e74944a30` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:19.725446 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b49a9c-6d09-4865-b545-9df0f215b0f1 None admin] RBAC: Authorizing `identity:get_group(group_id=5cdf3be8fcaa4c96b6acbc1e74944a30)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:19.727207 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b49a9c-6d09-4865-b545-9df0f215b0f1 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:19.729185 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 188/377] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Jul 26 15:25:19 2022] GET /identity/v3/groups/5cdf3be8fcaa4c96b6acbc1e74944a30 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:19.736089 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b49a9c-6d09-4865-b545-9df0f215b0f1 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:19.864512 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:19.869512 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b49a9c-6d09-4865-b545-9df0f215b0f1 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:19.912574 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db7ad77-fea8-4bd4-8aa4-706a5b98af8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:19.913534 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db7ad77-fea8-4bd4-8aa4-706a5b98af8e None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:19.914022 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db7ad77-fea8-4bd4-8aa4-706a5b98af8e None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:19.914495 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db7ad77-fea8-4bd4-8aa4-706a5b98af8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:19.916007 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db7ad77-fea8-4bd4-8aa4-706a5b98af8e None admin] RBAC: Adding query filter params (group.id=5cdf3be8fcaa4c96b6acbc1e74944a30, role.id=fd8f80bccab248edbb1d09ec187a8113, scope.project.id=24c3fa325d8a41dc8ac86599b7fb5180) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:19.916611 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db7ad77-fea8-4bd4-8aa4-706a5b98af8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:19.918298 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db7ad77-fea8-4bd4-8aa4-706a5b98af8e None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:19.932553 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 189/378] 10.222.0.18 () {56 vars in 1376 bytes} [Tue Jul 26 15:25:19 2022] GET /identity/v3/role_assignments?group.id=5cdf3be8fcaa4c96b6acbc1e74944a30&scope.project.id=24c3fa325d8a41dc8ac86599b7fb5180&role.id=fd8f80bccab248edbb1d09ec187a8113 => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:19.992006 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84aaea8-ddd5-4584-9dd6-114fda7998d9 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:20.039576 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:20.068022 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde9c7fe-50d9-42c2-aba1-831cea2f9d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:20.069136 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde9c7fe-50d9-42c2-aba1-831cea2f9d92 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:20.069626 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde9c7fe-50d9-42c2-aba1-831cea2f9d92 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:20.070090 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde9c7fe-50d9-42c2-aba1-831cea2f9d92 None admin] PATH_INFO: `/v3/groups/4a49c95bf0bb4d5788ac3ee8bb35f89e` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:20.082572 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde9c7fe-50d9-42c2-aba1-831cea2f9d92 None admin] RBAC: Authorizing `identity:get_group(group_id=4a49c95bf0bb4d5788ac3ee8bb35f89e)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:20.086096 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde9c7fe-50d9-42c2-aba1-831cea2f9d92 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:20.089907 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 190/379] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Jul 26 15:25:19 2022] GET /identity/v3/groups/4a49c95bf0bb4d5788ac3ee8bb35f89e => generated 229 bytes in 417 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:20.101073 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db7ad77-fea8-4bd4-8aa4-706a5b98af8e None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:20.329764 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db7ad77-fea8-4bd4-8aa4-706a5b98af8e None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:20.396974 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bd787f-cbfe-4f79-b936-f36ff3ec40b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:20.398013 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd787f-cbfe-4f79-b936-f36ff3ec40b5 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:20.398521 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd787f-cbfe-4f79-b936-f36ff3ec40b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:20.399006 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd787f-cbfe-4f79-b936-f36ff3ec40b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:20.400493 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bd787f-cbfe-4f79-b936-f36ff3ec40b5 None admin] RBAC: Adding query filter params (group.id=4a49c95bf0bb4d5788ac3ee8bb35f89e, role.id=2c659645e15c4204b1457556939397cb, scope.project.id=1316e00006b74e70a667f12420c63a2c) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:20.401058 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bd787f-cbfe-4f79-b936-f36ff3ec40b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:20.403714 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bd787f-cbfe-4f79-b936-f36ff3ec40b5 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:20.414510 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 190/380] 10.222.0.18 () {56 vars in 1376 bytes} [Tue Jul 26 15:25:20 2022] GET /identity/v3/role_assignments?group.id=4a49c95bf0bb4d5788ac3ee8bb35f89e&scope.project.id=1316e00006b74e70a667f12420c63a2c&role.id=2c659645e15c4204b1457556939397cb => generated 260 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:21.197670 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0357af-3e78-410d-81e6-993d043446a7 None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:21.198160 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0357af-3e78-410d-81e6-993d043446a7 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:21.198563 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0357af-3e78-410d-81e6-993d043446a7 None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:21.201418 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 191/381] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:25:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:25:21.209749 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f174bbf-2f58-4b30-a677-22fa8e33a2dd None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:21.210219 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f174bbf-2f58-4b30-a677-22fa8e33a2dd None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:21.210686 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f174bbf-2f58-4b30-a677-22fa8e33a2dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:21.248691 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-4f174bbf-2f58-4b30-a677-22fa8e33a2dd None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:25:21.250836 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-4f174bbf-2f58-4b30-a677-22fa8e33a2dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:25:21.305260 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:21.422133 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 191/382] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:25:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:25:21.494830 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0357af-3e78-410d-81e6-993d043446a7 None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:21.643770 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0357af-3e78-410d-81e6-993d043446a7 None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:21.697939 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d38cd0-e3a3-440c-9971-ae086ea1210e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:21.698618 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d38cd0-e3a3-440c-9971-ae086ea1210e None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:21.698903 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d38cd0-e3a3-440c-9971-ae086ea1210e None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:21.699205 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d38cd0-e3a3-440c-9971-ae086ea1210e None admin] PATH_INFO: `/v3/roles/member` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:21.717371 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d38cd0-e3a3-440c-9971-ae086ea1210e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:25:21.722950 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-62d38cd0-e3a3-440c-9971-ae086ea1210e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 15:25:21.722950 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:25:21.722950 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:25:21.722950 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:25:21.722950 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:25:21.722950 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:25:21.722950 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:25:21.722950 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:25:21.722950 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:25:21.722950 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:25:21.722950 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:25:21.722950 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:25:21.722950 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:25:21.722950 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:25:21.722950 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:25:21.722950 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:25:21.724286 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:25:21.724286 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:25:21.724286 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:25:21.724286 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:25:21.724286 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:25:21.724286 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:25:21.724286 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:25:21.724286 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:25:21.724286 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:25:21.724286 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:25:21.724286 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:25:21.724286 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:25:21.724286 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:25:21.724286 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:25:21.724286 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:25:21.724286 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:25:21.726388 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:25:21.726388 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:25:21.726388 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:25:21.726388 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:25:21.726388 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:25:21.726388 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:25:21.726388 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:25:21.726388 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:25:21.726388 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:25:21.726388 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:25:21.726388 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 15:25:21.726388 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:25:21.726388 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 192/383] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 15:25:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:25:21.733786 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f174bbf-2f58-4b30-a677-22fa8e33a2dd None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:21.881536 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f174bbf-2f58-4b30-a677-22fa8e33a2dd None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:21.939910 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c069c63-66a4-4bdb-af2f-7346d7d5231c None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:21.940329 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c069c63-66a4-4bdb-af2f-7346d7d5231c None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:21.940583 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c069c63-66a4-4bdb-af2f-7346d7d5231c None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:21.941960 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 193/384] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:25:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:25:21.946321 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90791f0-99b5-47e9-9c3f-5ffe83db1af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:21.947215 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90791f0-99b5-47e9-9c3f-5ffe83db1af1 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:21.947665 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90791f0-99b5-47e9-9c3f-5ffe83db1af1 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:21.948078 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90791f0-99b5-47e9-9c3f-5ffe83db1af1 None admin] PATH_INFO: `/v3/roles` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:21.949003 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90791f0-99b5-47e9-9c3f-5ffe83db1af1 None admin] RBAC: Adding query filter params (name=member) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:21.949465 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90791f0-99b5-47e9-9c3f-5ffe83db1af1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:21.949893 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c978f-b772-4059-b01d-a91609416400 None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:21.950188 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c978f-b772-4059-b01d-a91609416400 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:21.951027 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c978f-b772-4059-b01d-a91609416400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:21.952140 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90791f0-99b5-47e9-9c3f-5ffe83db1af1 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:21.962048 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 192/385] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jul 26 15:25:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:21.978726 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90791f0-99b5-47e9-9c3f-5ffe83db1af1 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:21.984138 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-f31c978f-b772-4059-b01d-a91609416400 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:25:21.985423 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-f31c978f-b772-4059-b01d-a91609416400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:25:22.026936 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:22.075561 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:22.140847 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 194/386] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:25:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:25:22.172620 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90791f0-99b5-47e9-9c3f-5ffe83db1af1 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:22.209601 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493f54d2-1da6-4233-bf8c-454b651e35b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:22.210262 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f54d2-1da6-4233-bf8c-454b651e35b8 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:22.210553 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f54d2-1da6-4233-bf8c-454b651e35b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:22.210834 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f54d2-1da6-4233-bf8c-454b651e35b8 None admin] PATH_INFO: `/v3/groups/5cdf3be8fcaa4c96b6acbc1e74944a30` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:22.212077 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493f54d2-1da6-4233-bf8c-454b651e35b8 None admin] RBAC: Authorizing `identity:get_group(group_id=5cdf3be8fcaa4c96b6acbc1e74944a30)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:22.213834 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493f54d2-1da6-4233-bf8c-454b651e35b8 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:22.216460 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 193/387] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Jul 26 15:25:21 2022] GET /identity/v3/groups/5cdf3be8fcaa4c96b6acbc1e74944a30 => generated 226 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:25:22.221958 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31c978f-b772-4059-b01d-a91609416400 None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:22.224252 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493f54d2-1da6-4233-bf8c-454b651e35b8 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:22.481413 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31c978f-b772-4059-b01d-a91609416400 None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:22.595673 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271b89a8-2629-4327-bb9a-ef423a7e7de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:22.597615 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b89a8-2629-4327-bb9a-ef423a7e7de6 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:22.598206 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b89a8-2629-4327-bb9a-ef423a7e7de6 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:22.598708 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b89a8-2629-4327-bb9a-ef423a7e7de6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:22.613300 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:22.640109 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271b89a8-2629-4327-bb9a-ef423a7e7de6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:25:22.655220 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-271b89a8-2629-4327-bb9a-ef423a7e7de6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 15:25:22.655220 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:25:22.655220 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:25:22.655220 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:25:22.655220 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:25:22.655220 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:25:22.655220 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:25:22.655220 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:25:22.655220 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:25:22.655220 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:25:22.655220 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:25:22.655220 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:25:22.655220 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:25:22.655220 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:25:22.655220 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:25:22.655220 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:25:22.656095 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:25:22.656095 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:25:22.656095 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:25:22.656095 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:25:22.656095 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:25:22.656095 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:25:22.656095 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:25:22.656095 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:25:22.656095 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:25:22.656095 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:25:22.656095 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:25:22.656095 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:25:22.656095 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:25:22.656095 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:25:22.656095 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:25:22.656095 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:25:22.656882 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:25:22.656882 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:25:22.656882 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:25:22.656882 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:25:22.656882 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:25:22.656882 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:25:22.656882 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:25:22.656882 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:25:22.656882 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:25:22.656882 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:25:22.656882 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 15:25:22.656882 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:25:22.658512 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 195/388] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jul 26 15:25:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 437 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:25:22.676224 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271b89a8-2629-4327-bb9a-ef423a7e7de6 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:22.707330 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493f54d2-1da6-4233-bf8c-454b651e35b8 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:22.826891 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:22.862715 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d57e52-3941-440e-8501-c22e0e88118e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:22.863515 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d57e52-3941-440e-8501-c22e0e88118e None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:22.863794 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d57e52-3941-440e-8501-c22e0e88118e None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:22.864076 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d57e52-3941-440e-8501-c22e0e88118e None admin] PATH_INFO: `/v3/projects/e99ebc2f1eb141dc8c8555d0aea0cd1f` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:22.873192 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d57e52-3941-440e-8501-c22e0e88118e None admin] RBAC: Authorizing `identity:get_project(project_id=e99ebc2f1eb141dc8c8555d0aea0cd1f)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:22.874693 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d57e52-3941-440e-8501-c22e0e88118e None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:22.876527 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 194/389] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 15:25:22 2022] GET /identity/v3/projects/e99ebc2f1eb141dc8c8555d0aea0cd1f => generated 298 bytes in 653 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:22.877756 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51051111-478d-48a0-bc82-ceb74b9c60f2 None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:22.878039 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51051111-478d-48a0-bc82-ceb74b9c60f2 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:22.878320 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51051111-478d-48a0-bc82-ceb74b9c60f2 None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:22.890367 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 195/390] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:25:22 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:25:22.890367 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51051111-478d-48a0-bc82-ceb74b9c60f2 None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:23.080639 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51051111-478d-48a0-bc82-ceb74b9c60f2 None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:23.086143 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271b89a8-2629-4327-bb9a-ef423a7e7de6 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:23.125261 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa94a52c-dc9f-4638-882c-d06921825a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:23.129890 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa94a52c-dc9f-4638-882c-d06921825a84 None admin] REQUEST_METHOD: `PUT` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:23.130239 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa94a52c-dc9f-4638-882c-d06921825a84 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:23.130545 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa94a52c-dc9f-4638-882c-d06921825a84 None admin] PATH_INFO: `/v3/projects/e99ebc2f1eb141dc8c8555d0aea0cd1f/groups/5cdf3be8fcaa4c96b6acbc1e74944a30/roles/fd8f80bccab248edbb1d09ec187a8113` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:23.133139 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa94a52c-dc9f-4638-882c-d06921825a84 None admin] RBAC: Authorizing `identity:create_grant(project_id=e99ebc2f1eb141dc8c8555d0aea0cd1f, group_id=5cdf3be8fcaa4c96b6acbc1e74944a30, role_id=fd8f80bccab248edbb1d09ec187a8113)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:23.134412 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa94a52c-dc9f-4638-882c-d06921825a84 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:23.164390 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963a9f00-54f4-4956-bde3-abf4f7cb0b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:23.165091 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a9f00-54f4-4956-bde3-abf4f7cb0b67 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:23.165374 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a9f00-54f4-4956-bde3-abf4f7cb0b67 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:23.165645 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a9f00-54f4-4956-bde3-abf4f7cb0b67 None admin] PATH_INFO: `/v3/roles` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:23.166389 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963a9f00-54f4-4956-bde3-abf4f7cb0b67 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:23.166685 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963a9f00-54f4-4956-bde3-abf4f7cb0b67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:23.168164 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963a9f00-54f4-4956-bde3-abf4f7cb0b67 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:23.179180 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 196/391] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 15:25:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 503 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:23.187903 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a794fc86-0df1-4d94-9610-eac17ec3c337 None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:23.187903 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a794fc86-0df1-4d94-9610-eac17ec3c337 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:23.187903 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a794fc86-0df1-4d94-9610-eac17ec3c337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:23.205299 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-a794fc86-0df1-4d94-9610-eac17ec3c337 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:25:23.213469 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 196/392] 10.222.0.18 () {58 vars in 1442 bytes} [Tue Jul 26 15:25:22 2022] PUT /identity/v3/projects/e99ebc2f1eb141dc8c8555d0aea0cd1f/groups/5cdf3be8fcaa4c96b6acbc1e74944a30/roles/fd8f80bccab248edbb1d09ec187a8113 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:25:23.219430 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa94a52c-dc9f-4638-882c-d06921825a84 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:23.219665 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-a794fc86-0df1-4d94-9610-eac17ec3c337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:25:23.251914 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:23.381144 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 197/393] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:25:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:25:23.404640 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa94a52c-dc9f-4638-882c-d06921825a84 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:23.420751 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a794fc86-0df1-4d94-9610-eac17ec3c337 None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:23.451842 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a325d84b-fcd9-4d7d-96c4-e6965150574f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:23.453057 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a325d84b-fcd9-4d7d-96c4-e6965150574f None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:23.453593 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a325d84b-fcd9-4d7d-96c4-e6965150574f None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:23.454124 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a325d84b-fcd9-4d7d-96c4-e6965150574f None admin] PATH_INFO: `/v3/groups/5cdf3be8fcaa4c96b6acbc1e74944a30` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:23.455836 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a325d84b-fcd9-4d7d-96c4-e6965150574f None admin] RBAC: Authorizing `identity:get_group(group_id=5cdf3be8fcaa4c96b6acbc1e74944a30)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:23.457849 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a325d84b-fcd9-4d7d-96c4-e6965150574f None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:23.460453 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 197/394] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Jul 26 15:25:23 2022] GET /identity/v3/groups/5cdf3be8fcaa4c96b6acbc1e74944a30 => generated 226 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:23.465823 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a325d84b-fcd9-4d7d-96c4-e6965150574f None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:23.493038 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:23.615487 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a794fc86-0df1-4d94-9610-eac17ec3c337 None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:23.662545 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:23.699291 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a325d84b-fcd9-4d7d-96c4-e6965150574f None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:23.700432 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0630bb25-660e-4863-af8e-8dbb3d213ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:23.701886 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630bb25-660e-4863-af8e-8dbb3d213ccb None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:23.703340 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630bb25-660e-4863-af8e-8dbb3d213ccb None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:23.709499 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630bb25-660e-4863-af8e-8dbb3d213ccb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:23.736066 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0630bb25-660e-4863-af8e-8dbb3d213ccb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:25:23.750128 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-0630bb25-660e-4863-af8e-8dbb3d213ccb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 15:25:23.750128 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:25:23.750128 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:25:23.750128 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:25:23.750128 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:25:23.750128 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:25:23.750128 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:25:23.750128 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:25:23.750128 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:25:23.750128 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:25:23.750128 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:25:23.750128 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:25:23.750128 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:25:23.750128 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:25:23.750128 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:25:23.750128 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:25:23.751975 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:25:23.751975 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:25:23.751975 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:25:23.751975 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:25:23.751975 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:25:23.751975 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:25:23.751975 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:25:23.751975 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:25:23.751975 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:25:23.751975 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:25:23.751975 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:25:23.751975 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:25:23.751975 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:25:23.751975 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:25:23.751975 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:25:23.751975 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:25:23.753554 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:25:23.753554 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:25:23.753554 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:25:23.753554 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:25:23.753554 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:25:23.753554 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:25:23.753554 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:25:23.753554 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:25:23.753554 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:25:23.753554 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:25:23.753554 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 15:25:23.753554 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:25:23.758132 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 198/395] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jul 26 15:25:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:25:23.760700 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39772bc-819b-4088-a0f5-0bcee0b3d883 None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:23.761449 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39772bc-819b-4088-a0f5-0bcee0b3d883 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:23.761960 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39772bc-819b-4088-a0f5-0bcee0b3d883 None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:23.765299 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 199/396] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:25:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:25:23.766777 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39772bc-819b-4088-a0f5-0bcee0b3d883 None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:23.787095 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa2d8a6-be3b-4738-9f32-ded2014f51dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:23.789135 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa2d8a6-be3b-4738-9f32-ded2014f51dc None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:23.789947 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa2d8a6-be3b-4738-9f32-ded2014f51dc None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:23.790991 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa2d8a6-be3b-4738-9f32-ded2014f51dc None admin] PATH_INFO: `/v3/projects/e99ebc2f1eb141dc8c8555d0aea0cd1f` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:23.794929 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa2d8a6-be3b-4738-9f32-ded2014f51dc None admin] RBAC: Authorizing `identity:get_project(project_id=e99ebc2f1eb141dc8c8555d0aea0cd1f)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:23.798984 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa2d8a6-be3b-4738-9f32-ded2014f51dc None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:23.804249 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 198/397] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 15:25:23 2022] GET /identity/v3/projects/e99ebc2f1eb141dc8c8555d0aea0cd1f => generated 298 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:23.806616 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23199e7-1300-42c3-8490-20ec9b811efa None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:23.807299 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23199e7-1300-42c3-8490-20ec9b811efa None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:23.808116 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23199e7-1300-42c3-8490-20ec9b811efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:23.846322 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-d23199e7-1300-42c3-8490-20ec9b811efa None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:25:23.848716 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-d23199e7-1300-42c3-8490-20ec9b811efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:25:23.948641 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:23.989989 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39772bc-819b-4088-a0f5-0bcee0b3d883 None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:24.007389 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 199/398] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:25:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:25:24.009231 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23199e7-1300-42c3-8490-20ec9b811efa None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:24.064493 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b14157-b33d-46e5-9988-41d350e48142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:24.065466 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b14157-b33d-46e5-9988-41d350e48142 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:24.065887 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b14157-b33d-46e5-9988-41d350e48142 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:24.066304 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b14157-b33d-46e5-9988-41d350e48142 None admin] PATH_INFO: `/v3/roles` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:24.067524 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b14157-b33d-46e5-9988-41d350e48142 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:24.067995 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b14157-b33d-46e5-9988-41d350e48142 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:24.070929 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b14157-b33d-46e5-9988-41d350e48142 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:24.087480 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 200/399] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 15:25:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:24.088834 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b14157-b33d-46e5-9988-41d350e48142 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:24.183314 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:24.227238 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23199e7-1300-42c3-8490-20ec9b811efa None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:24.304529 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b14157-b33d-46e5-9988-41d350e48142 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:24.308606 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2009d6b0-2dc8-4e60-b321-7404d0de66c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:24.309540 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2009d6b0-2dc8-4e60-b321-7404d0de66c7 None admin] REQUEST_METHOD: `PUT` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:24.310020 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2009d6b0-2dc8-4e60-b321-7404d0de66c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:24.310426 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2009d6b0-2dc8-4e60-b321-7404d0de66c7 None admin] PATH_INFO: `/v3/projects/e99ebc2f1eb141dc8c8555d0aea0cd1f/groups/5cdf3be8fcaa4c96b6acbc1e74944a30/roles/c86cdde38565431ebacf53dcfc4d863b` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:24.313089 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2009d6b0-2dc8-4e60-b321-7404d0de66c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=e99ebc2f1eb141dc8c8555d0aea0cd1f, group_id=5cdf3be8fcaa4c96b6acbc1e74944a30, role_id=c86cdde38565431ebacf53dcfc4d863b)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:24.314831 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2009d6b0-2dc8-4e60-b321-7404d0de66c7 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:24.368840 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8376d2-8c70-4b11-9737-4917434491d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:24.369986 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8376d2-8c70-4b11-9737-4917434491d7 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:24.370488 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8376d2-8c70-4b11-9737-4917434491d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:24.370995 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8376d2-8c70-4b11-9737-4917434491d7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:24.392475 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8376d2-8c70-4b11-9737-4917434491d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:25:24.403956 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-ea8376d2-8c70-4b11-9737-4917434491d7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 15:25:24.403956 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:25:24.403956 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:25:24.403956 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:25:24.403956 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:25:24.403956 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:25:24.403956 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:25:24.403956 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:25:24.403956 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:25:24.403956 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:25:24.403956 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:25:24.403956 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:25:24.403956 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:25:24.403956 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:25:24.403956 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:25:24.403956 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:25:24.405997 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:25:24.405997 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:25:24.405997 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:25:24.405997 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:25:24.405997 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:25:24.405997 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:25:24.405997 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:25:24.405997 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:25:24.405997 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:25:24.405997 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:25:24.405997 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:25:24.405997 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:25:24.405997 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:25:24.405997 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:25:24.405997 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:25:24.405997 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:25:24.416349 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:25:24.416349 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:25:24.416349 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:25:24.416349 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:25:24.416349 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:25:24.416349 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:25:24.416349 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:25:24.416349 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:25:24.416349 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:25:24.416349 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:25:24.416349 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 15:25:24.416349 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:25:24.419544 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 200/400] 10.222.0.18 () {58 vars in 1442 bytes} [Tue Jul 26 15:25:24 2022] PUT /identity/v3/projects/e99ebc2f1eb141dc8c8555d0aea0cd1f/groups/5cdf3be8fcaa4c96b6acbc1e74944a30/roles/c86cdde38565431ebacf53dcfc4d863b => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:25:24.419746 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 201/401] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 15:25:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:25:24.419746 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63842d6-6496-4140-9ad0-cb601c65a977 None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:24.419746 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63842d6-6496-4140-9ad0-cb601c65a977 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:24.419746 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63842d6-6496-4140-9ad0-cb601c65a977 None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:24.420599 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2009d6b0-2dc8-4e60-b321-7404d0de66c7 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:24.420794 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 202/402] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:25:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:25:24.420794 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63842d6-6496-4140-9ad0-cb601c65a977 None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:24.442820 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:24.643451 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2009d6b0-2dc8-4e60-b321-7404d0de66c7 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:24.663522 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63842d6-6496-4140-9ad0-cb601c65a977 None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:24.734126 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde9a49a-2eb8-4219-abb3-6b3f9c266696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:24.735345 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb5243f-4210-4793-b842-72fd0936e675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:24.736099 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde9a49a-2eb8-4219-abb3-6b3f9c266696 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:24.736398 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb5243f-4210-4793-b842-72fd0936e675 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:24.736896 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb5243f-4210-4793-b842-72fd0936e675 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:24.737255 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde9a49a-2eb8-4219-abb3-6b3f9c266696 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:24.737406 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb5243f-4210-4793-b842-72fd0936e675 None admin] PATH_INFO: `/v3/roles` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:24.737892 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde9a49a-2eb8-4219-abb3-6b3f9c266696 None admin] PATH_INFO: `/v3/groups/5cdf3be8fcaa4c96b6acbc1e74944a30` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:24.738804 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb5243f-4210-4793-b842-72fd0936e675 None admin] RBAC: Adding query filter params (name=member) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:24.739685 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde9a49a-2eb8-4219-abb3-6b3f9c266696 None admin] RBAC: Authorizing `identity:get_group(group_id=5cdf3be8fcaa4c96b6acbc1e74944a30)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:24.740695 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb5243f-4210-4793-b842-72fd0936e675 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:24.742322 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde9a49a-2eb8-4219-abb3-6b3f9c266696 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:24.743543 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb5243f-4210-4793-b842-72fd0936e675 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:24.746495 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 201/403] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Jul 26 15:25:24 2022] GET /identity/v3/groups/5cdf3be8fcaa4c96b6acbc1e74944a30 => generated 226 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:24.749522 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e620c02b-1485-45c0-a35f-75f3e373be41 None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:24.750036 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e620c02b-1485-45c0-a35f-75f3e373be41 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:24.750515 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e620c02b-1485-45c0-a35f-75f3e373be41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:24.761477 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 203/404] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jul 26 15:25:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:24.763597 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb5243f-4210-4793-b842-72fd0936e675 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:24.782451 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-e620c02b-1485-45c0-a35f-75f3e373be41 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:25:24.784819 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-e620c02b-1485-45c0-a35f-75f3e373be41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:25:24.791005 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:24.919564 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:24.929063 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 202/405] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:25:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:25:24.930293 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e620c02b-1485-45c0-a35f-75f3e373be41 None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:24.992942 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb5243f-4210-4793-b842-72fd0936e675 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:25.063497 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2182863a-efd0-41f0-b531-c9316465902e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:25.064154 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2182863a-efd0-41f0-b531-c9316465902e None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:25.064434 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2182863a-efd0-41f0-b531-c9316465902e None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:25.064711 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2182863a-efd0-41f0-b531-c9316465902e None admin] PATH_INFO: `/v3/projects/24c3fa325d8a41dc8ac86599b7fb5180` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:25.066775 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2182863a-efd0-41f0-b531-c9316465902e None admin] RBAC: Authorizing `identity:get_project(project_id=24c3fa325d8a41dc8ac86599b7fb5180)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:25.068516 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2182863a-efd0-41f0-b531-c9316465902e None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:25.071052 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 204/406] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 15:25:24 2022] GET /identity/v3/projects/24c3fa325d8a41dc8ac86599b7fb5180 => generated 302 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:25.071895 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2182863a-efd0-41f0-b531-c9316465902e None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:25.114380 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e620c02b-1485-45c0-a35f-75f3e373be41 None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:25.183015 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9e70fe-3bc5-41b0-8a3e-7b3d2d326b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:25.185304 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e70fe-3bc5-41b0-8a3e-7b3d2d326b10 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:25.186074 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e70fe-3bc5-41b0-8a3e-7b3d2d326b10 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:25.186843 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e70fe-3bc5-41b0-8a3e-7b3d2d326b10 None admin] PATH_INFO: `/v3/groups/5cdf3be8fcaa4c96b6acbc1e74944a30` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:25.189411 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9e70fe-3bc5-41b0-8a3e-7b3d2d326b10 None admin] RBAC: Authorizing `identity:get_group(group_id=5cdf3be8fcaa4c96b6acbc1e74944a30)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:25.192493 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9e70fe-3bc5-41b0-8a3e-7b3d2d326b10 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:25.196347 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 203/407] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Jul 26 15:25:24 2022] GET /identity/v3/groups/5cdf3be8fcaa4c96b6acbc1e74944a30 => generated 226 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:25.198181 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9e70fe-3bc5-41b0-8a3e-7b3d2d326b10 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:25.204008 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2182863a-efd0-41f0-b531-c9316465902e None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:25.214677 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:25.249172 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e15de46-86e4-4a98-a26b-18efc2c31b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:25.249729 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15de46-86e4-4a98-a26b-18efc2c31b24 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:25.250014 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15de46-86e4-4a98-a26b-18efc2c31b24 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:25.250324 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15de46-86e4-4a98-a26b-18efc2c31b24 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:25.259283 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:25.265366 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e15de46-86e4-4a98-a26b-18efc2c31b24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:25:25.271731 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-9e15de46-86e4-4a98-a26b-18efc2c31b24 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 15:25:25.271731 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:25:25.271731 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:25:25.271731 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:25:25.271731 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:25:25.271731 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:25:25.271731 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:25:25.271731 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:25:25.271731 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:25:25.271731 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:25:25.271731 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:25:25.271731 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:25:25.271731 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:25:25.271731 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:25:25.271731 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:25:25.271731 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:25:25.273717 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:25:25.273717 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:25:25.273717 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:25:25.273717 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:25:25.273717 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:25:25.273717 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:25:25.273717 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:25:25.273717 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:25:25.273717 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:25:25.273717 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:25:25.273717 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:25:25.273717 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:25:25.273717 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:25:25.273717 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:25:25.273717 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:25:25.273717 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:25:25.275293 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:25:25.275293 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:25:25.275293 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:25:25.275293 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:25:25.275293 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:25:25.275293 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:25:25.275293 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:25:25.275293 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:25:25.275293 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:25:25.275293 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:25:25.275293 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 15:25:25.275293 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:25:25.275293 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 205/408] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jul 26 15:25:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:25:25.279854 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e15de46-86e4-4a98-a26b-18efc2c31b24 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:25.394297 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e15de46-86e4-4a98-a26b-18efc2c31b24 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:25.413113 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9e70fe-3bc5-41b0-8a3e-7b3d2d326b10 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:25.433658 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d981ac74-f056-4b40-b749-23d19d0f82a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:25.434106 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981ac74-f056-4b40-b749-23d19d0f82a3 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:25.437931 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981ac74-f056-4b40-b749-23d19d0f82a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:25.437931 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981ac74-f056-4b40-b749-23d19d0f82a3 None admin] PATH_INFO: `/v3/projects/24c3fa325d8a41dc8ac86599b7fb5180` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:25.437931 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d981ac74-f056-4b40-b749-23d19d0f82a3 None admin] RBAC: Authorizing `identity:get_project(project_id=24c3fa325d8a41dc8ac86599b7fb5180)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:25.438304 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d981ac74-f056-4b40-b749-23d19d0f82a3 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:25.439843 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 206/409] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 15:25:25 2022] GET /identity/v3/projects/24c3fa325d8a41dc8ac86599b7fb5180 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:25.440627 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d981ac74-f056-4b40-b749-23d19d0f82a3 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:25.490513 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19acb38c-45ef-4d43-be86-354da96e9bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:25.492183 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19acb38c-45ef-4d43-be86-354da96e9bdb None admin] REQUEST_METHOD: `PUT` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:25.493092 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19acb38c-45ef-4d43-be86-354da96e9bdb None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:25.494020 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19acb38c-45ef-4d43-be86-354da96e9bdb None admin] PATH_INFO: `/v3/projects/24c3fa325d8a41dc8ac86599b7fb5180/groups/5cdf3be8fcaa4c96b6acbc1e74944a30/roles/c86cdde38565431ebacf53dcfc4d863b` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:25.499552 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19acb38c-45ef-4d43-be86-354da96e9bdb None admin] RBAC: Authorizing `identity:create_grant(project_id=24c3fa325d8a41dc8ac86599b7fb5180, group_id=5cdf3be8fcaa4c96b6acbc1e74944a30, role_id=c86cdde38565431ebacf53dcfc4d863b)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:25.503088 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19acb38c-45ef-4d43-be86-354da96e9bdb None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:25.516417 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:25.562052 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d981ac74-f056-4b40-b749-23d19d0f82a3 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:25.629110 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b523df-e0f6-4686-806a-02610ba09135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:25.630194 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b523df-e0f6-4686-806a-02610ba09135 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:25.630671 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b523df-e0f6-4686-806a-02610ba09135 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:25.631197 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b523df-e0f6-4686-806a-02610ba09135 None admin] PATH_INFO: `/v3/roles` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:25.632556 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b523df-e0f6-4686-806a-02610ba09135 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:25.633090 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b523df-e0f6-4686-806a-02610ba09135 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:25.635972 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b523df-e0f6-4686-806a-02610ba09135 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:25.656998 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 207/410] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 15:25:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:25.658749 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b523df-e0f6-4686-806a-02610ba09135 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:25.675558 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 204/411] 10.222.0.18 () {58 vars in 1442 bytes} [Tue Jul 26 15:25:25 2022] PUT /identity/v3/projects/24c3fa325d8a41dc8ac86599b7fb5180/groups/5cdf3be8fcaa4c96b6acbc1e74944a30/roles/c86cdde38565431ebacf53dcfc4d863b => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:25:25.687171 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19acb38c-45ef-4d43-be86-354da96e9bdb None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:25.915034 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:25.954434 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b523df-e0f6-4686-806a-02610ba09135 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:25.966685 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19acb38c-45ef-4d43-be86-354da96e9bdb None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:26.005934 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:26.021425 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169cc588-44d0-4cb7-9ef7-d7d58709cb48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:26.022101 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169cc588-44d0-4cb7-9ef7-d7d58709cb48 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:26.022362 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da33ebd4-0f96-49fb-bc67-bfc21fa485a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:26.022538 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169cc588-44d0-4cb7-9ef7-d7d58709cb48 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:26.022675 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169cc588-44d0-4cb7-9ef7-d7d58709cb48 None admin] PATH_INFO: `/v3/groups/4a49c95bf0bb4d5788ac3ee8bb35f89e` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:26.023549 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da33ebd4-0f96-49fb-bc67-bfc21fa485a4 None admin] REQUEST_METHOD: `PUT` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:26.024118 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da33ebd4-0f96-49fb-bc67-bfc21fa485a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:26.024528 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da33ebd4-0f96-49fb-bc67-bfc21fa485a4 None admin] PATH_INFO: `/v3/projects/24c3fa325d8a41dc8ac86599b7fb5180/groups/5cdf3be8fcaa4c96b6acbc1e74944a30/roles/fd8f80bccab248edbb1d09ec187a8113` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:26.027524 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da33ebd4-0f96-49fb-bc67-bfc21fa485a4 None admin] RBAC: Authorizing `identity:create_grant(project_id=24c3fa325d8a41dc8ac86599b7fb5180, group_id=5cdf3be8fcaa4c96b6acbc1e74944a30, role_id=fd8f80bccab248edbb1d09ec187a8113)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:26.027944 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169cc588-44d0-4cb7-9ef7-d7d58709cb48 None admin] RBAC: Authorizing `identity:get_group(group_id=4a49c95bf0bb4d5788ac3ee8bb35f89e)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:26.029986 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169cc588-44d0-4cb7-9ef7-d7d58709cb48 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:26.030913 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da33ebd4-0f96-49fb-bc67-bfc21fa485a4 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:26.032168 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 205/412] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Jul 26 15:25:25 2022] GET /identity/v3/groups/4a49c95bf0bb4d5788ac3ee8bb35f89e => generated 229 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:26.048093 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169cc588-44d0-4cb7-9ef7-d7d58709cb48 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:26.120828 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 208/413] 10.222.0.18 () {58 vars in 1442 bytes} [Tue Jul 26 15:25:25 2022] PUT /identity/v3/projects/24c3fa325d8a41dc8ac86599b7fb5180/groups/5cdf3be8fcaa4c96b6acbc1e74944a30/roles/fd8f80bccab248edbb1d09ec187a8113 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:25:26.128700 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892cf900-4ee2-4e67-8b79-b2cd88d140b0 None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:26.129821 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892cf900-4ee2-4e67-8b79-b2cd88d140b0 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:26.130843 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892cf900-4ee2-4e67-8b79-b2cd88d140b0 None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:26.136903 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 209/414] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:25:26 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 15:25:26.155835 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3050bec8-17f3-4206-93a7-c3305209ce30 None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:26.156858 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3050bec8-17f3-4206-93a7-c3305209ce30 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:26.157736 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3050bec8-17f3-4206-93a7-c3305209ce30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:26.229584 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-3050bec8-17f3-4206-93a7-c3305209ce30 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:25:26.232047 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-3050bec8-17f3-4206-93a7-c3305209ce30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:25:26.316777 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169cc588-44d0-4cb7-9ef7-d7d58709cb48 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:26.396915 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b027b2-7660-49e1-97d8-3e76288e7bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:26.398480 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b027b2-7660-49e1-97d8-3e76288e7bbe None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:26.399272 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b027b2-7660-49e1-97d8-3e76288e7bbe None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:26.400036 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b027b2-7660-49e1-97d8-3e76288e7bbe None admin] PATH_INFO: `/v3/projects/1316e00006b74e70a667f12420c63a2c` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:26.404599 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b027b2-7660-49e1-97d8-3e76288e7bbe None admin] RBAC: Authorizing `identity:get_project(project_id=1316e00006b74e70a667f12420c63a2c)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:26.407795 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b027b2-7660-49e1-97d8-3e76288e7bbe None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:26.412256 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 206/415] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 15:25:26 2022] GET /identity/v3/projects/1316e00006b74e70a667f12420c63a2c => generated 344 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:26.419892 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 210/416] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:25:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 15:25:26.425248 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b027b2-7660-49e1-97d8-3e76288e7bbe None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:26.429885 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:26.474533 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3050bec8-17f3-4206-93a7-c3305209ce30 None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:26.624250 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b027b2-7660-49e1-97d8-3e76288e7bbe None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:26.672237 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3050bec8-17f3-4206-93a7-c3305209ce30 None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:26.708017 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:26.717042 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a1c598-f9f7-4886-b035-88e77abde677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:26.718785 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a1c598-f9f7-4886-b035-88e77abde677 None admin] REQUEST_METHOD: `PUT` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:26.719556 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a1c598-f9f7-4886-b035-88e77abde677 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:26.720337 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a1c598-f9f7-4886-b035-88e77abde677 None admin] PATH_INFO: `/v3/projects/1316e00006b74e70a667f12420c63a2c/groups/4a49c95bf0bb4d5788ac3ee8bb35f89e/roles/2c659645e15c4204b1457556939397cb` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:26.726389 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a1c598-f9f7-4886-b035-88e77abde677 None admin] RBAC: Authorizing `identity:create_grant(project_id=1316e00006b74e70a667f12420c63a2c, group_id=4a49c95bf0bb4d5788ac3ee8bb35f89e, role_id=2c659645e15c4204b1457556939397cb)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:26.729619 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a1c598-f9f7-4886-b035-88e77abde677 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:26.739274 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aba2ef-c9c4-42bf-87bc-02d5a14696f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:26.739486 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aba2ef-c9c4-42bf-87bc-02d5a14696f4 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:26.739806 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aba2ef-c9c4-42bf-87bc-02d5a14696f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:26.740217 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aba2ef-c9c4-42bf-87bc-02d5a14696f4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:26.753504 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aba2ef-c9c4-42bf-87bc-02d5a14696f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:25:26.758919 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-f6aba2ef-c9c4-42bf-87bc-02d5a14696f4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 15:25:26.758919 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:25:26.758919 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:25:26.758919 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:25:26.758919 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:25:26.758919 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:25:26.758919 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:25:26.758919 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:25:26.758919 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:25:26.758919 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:25:26.758919 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:25:26.758919 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:25:26.758919 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:25:26.758919 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:25:26.758919 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:25:26.758919 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:25:26.759899 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:25:26.759899 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:25:26.759899 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:25:26.759899 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:25:26.759899 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:25:26.759899 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:25:26.759899 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:25:26.759899 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:25:26.759899 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:25:26.759899 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:25:26.759899 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:25:26.759899 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:25:26.759899 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:25:26.759899 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:25:26.759899 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:25:26.759899 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:25:26.760728 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:25:26.760728 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:25:26.760728 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:25:26.760728 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:25:26.760728 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:25:26.760728 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:25:26.760728 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:25:26.760728 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:25:26.760728 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:25:26.760728 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:25:26.760728 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 15:25:26.760728 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:25:26.760728 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 211/417] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 15:25:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:25:26.768526 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aba2ef-c9c4-42bf-87bc-02d5a14696f4 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:26.806888 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 207/418] 10.222.0.18 () {58 vars in 1442 bytes} [Tue Jul 26 15:25:26 2022] PUT /identity/v3/projects/1316e00006b74e70a667f12420c63a2c/groups/4a49c95bf0bb4d5788ac3ee8bb35f89e/roles/2c659645e15c4204b1457556939397cb => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:25:26.891500 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aba2ef-c9c4-42bf-87bc-02d5a14696f4 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:26.931851 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716d2603-3582-4e02-b215-6abdad507c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:26.932498 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d2603-3582-4e02-b215-6abdad507c4b None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:26.932785 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d2603-3582-4e02-b215-6abdad507c4b None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:26.933063 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d2603-3582-4e02-b215-6abdad507c4b None admin] PATH_INFO: `/v3/roles` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:26.933811 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716d2603-3582-4e02-b215-6abdad507c4b None admin] RBAC: Adding query filter params (name=member) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:26.934123 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716d2603-3582-4e02-b215-6abdad507c4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:26.937431 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716d2603-3582-4e02-b215-6abdad507c4b None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:26.946434 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 212/419] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jul 26 15:25:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:25:26.953066 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a1c598-f9f7-4886-b035-88e77abde677 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:27.121600 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:27.173516 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a1c598-f9f7-4886-b035-88e77abde677 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:27.216885 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7104bcfe-1770-4eab-9c74-8e7b8d3dd106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:27.217537 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7104bcfe-1770-4eab-9c74-8e7b8d3dd106 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:27.217818 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7104bcfe-1770-4eab-9c74-8e7b8d3dd106 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:27.218097 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7104bcfe-1770-4eab-9c74-8e7b8d3dd106 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:27.330034 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7104bcfe-1770-4eab-9c74-8e7b8d3dd106 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:27.332848 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7104bcfe-1770-4eab-9c74-8e7b8d3dd106 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:27.440650 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:27.496250 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 208/420] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 15:25:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 15:25:27.502364 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716d2603-3582-4e02-b215-6abdad507c4b None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:27.565192 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:27.643702 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716d2603-3582-4e02-b215-6abdad507c4b None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:27.696430 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0ef90a-f1ef-492c-bba2-3d811111d11f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:27.697024 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ef90a-f1ef-492c-bba2-3d811111d11f None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:27.697367 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ef90a-f1ef-492c-bba2-3d811111d11f None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:27.697652 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ef90a-f1ef-492c-bba2-3d811111d11f None admin] PATH_INFO: `/v3/projects/e99ebc2f1eb141dc8c8555d0aea0cd1f` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:27.698931 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0ef90a-f1ef-492c-bba2-3d811111d11f None admin] RBAC: Authorizing `identity:get_project(project_id=e99ebc2f1eb141dc8c8555d0aea0cd1f)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:27.701266 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0ef90a-f1ef-492c-bba2-3d811111d11f None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:27.703505 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 213/421] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 15:25:27 2022] GET /identity/v3/projects/e99ebc2f1eb141dc8c8555d0aea0cd1f => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:27.709479 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7104bcfe-1770-4eab-9c74-8e7b8d3dd106 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:27.883530 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7104bcfe-1770-4eab-9c74-8e7b8d3dd106 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:27.927936 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed1eb31-dcc1-4de7-af9d-190d4fa7aa66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:27.929023 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed1eb31-dcc1-4de7-af9d-190d4fa7aa66 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:27.929503 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed1eb31-dcc1-4de7-af9d-190d4fa7aa66 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:27.929965 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed1eb31-dcc1-4de7-af9d-190d4fa7aa66 None admin] PATH_INFO: `/v3/groups/5cdf3be8fcaa4c96b6acbc1e74944a30` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:27.934510 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed1eb31-dcc1-4de7-af9d-190d4fa7aa66 None admin] RBAC: Authorizing `identity:get_group(group_id=5cdf3be8fcaa4c96b6acbc1e74944a30)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:27.936324 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed1eb31-dcc1-4de7-af9d-190d4fa7aa66 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:27.938348 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 209/422] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Jul 26 15:25:27 2022] GET /identity/v3/groups/5cdf3be8fcaa4c96b6acbc1e74944a30 => generated 226 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:25:27.943999 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0ef90a-f1ef-492c-bba2-3d811111d11f None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:28.082380 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0ef90a-f1ef-492c-bba2-3d811111d11f None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:28.093153 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:28.131676 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63df8b5-6a26-4697-9d02-e6e04f13d342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:28.132324 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63df8b5-6a26-4697-9d02-e6e04f13d342 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:28.132617 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63df8b5-6a26-4697-9d02-e6e04f13d342 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:28.132903 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63df8b5-6a26-4697-9d02-e6e04f13d342 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:28.133809 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63df8b5-6a26-4697-9d02-e6e04f13d342 None admin] RBAC: Adding query filter params (group.id=5cdf3be8fcaa4c96b6acbc1e74944a30, role.id=fd8f80bccab248edbb1d09ec187a8113, scope.project.id=e99ebc2f1eb141dc8c8555d0aea0cd1f) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:28.134134 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63df8b5-6a26-4697-9d02-e6e04f13d342 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:28.135669 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63df8b5-6a26-4697-9d02-e6e04f13d342 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:28.149102 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 214/423] 10.222.0.18 () {56 vars in 1376 bytes} [Tue Jul 26 15:25:27 2022] GET /identity/v3/role_assignments?group.id=5cdf3be8fcaa4c96b6acbc1e74944a30&scope.project.id=e99ebc2f1eb141dc8c8555d0aea0cd1f&role.id=fd8f80bccab248edbb1d09ec187a8113 => generated 611 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:28.278576 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c51c9af-bdad-4e65-89d5-df43d5a7e09d None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:28.279410 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c51c9af-bdad-4e65-89d5-df43d5a7e09d None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:28.279410 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c51c9af-bdad-4e65-89d5-df43d5a7e09d None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:28.280837 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 210/424] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:25:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:25:28.286317 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096f9d7-8c47-4963-8e27-4f44e30122bc None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:28.286699 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096f9d7-8c47-4963-8e27-4f44e30122bc None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:28.286962 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096f9d7-8c47-4963-8e27-4f44e30122bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:28.315586 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-a096f9d7-8c47-4963-8e27-4f44e30122bc None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:25:28.316816 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-a096f9d7-8c47-4963-8e27-4f44e30122bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:25:28.406522 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 215/425] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:25:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:25:28.431295 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c51c9af-bdad-4e65-89d5-df43d5a7e09d None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:28.481045 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:28.573599 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c51c9af-bdad-4e65-89d5-df43d5a7e09d None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:28.627744 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1835ed-ca7a-46a5-bd9f-0c8b0fa0279d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:28.628405 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1835ed-ca7a-46a5-bd9f-0c8b0fa0279d None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:28.628684 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1835ed-ca7a-46a5-bd9f-0c8b0fa0279d None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:28.628982 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1835ed-ca7a-46a5-bd9f-0c8b0fa0279d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:28.643208 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1835ed-ca7a-46a5-bd9f-0c8b0fa0279d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:25:28.648918 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application [None req-0a1835ed-ca7a-46a5-bd9f-0c8b0fa0279d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 15:25:28.648918 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:25:28.648918 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:25:28.648918 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:25:28.648918 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:25:28.648918 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:25:28.648918 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:25:28.648918 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:25:28.648918 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:25:28.648918 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:25:28.648918 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:25:28.648918 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:25:28.648918 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:25:28.648918 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:25:28.648918 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:25:28.648918 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:25:28.649846 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:25:28.649846 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:25:28.649846 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:25:28.649846 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:25:28.649846 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:25:28.649846 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:25:28.649846 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:25:28.649846 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:25:28.649846 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:25:28.649846 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:25:28.649846 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:25:28.649846 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application with Lock( Jul 26 15:25:28.649846 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:25:28.649846 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:25:28.649846 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:25:28.649846 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:25:28.650616 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:25:28.650616 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:25:28.650616 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:25:28.650616 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:25:28.650616 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:25:28.650616 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:25:28.650616 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:25:28.650616 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:25:28.650616 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:25:28.650616 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:25:28.650616 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 15:25:28.650616 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:25:28.650616 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 211/426] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jul 26 15:25:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:25:28.662030 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a096f9d7-8c47-4963-8e27-4f44e30122bc None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:28.730867 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff36bf68-b1b5-44e9-91ff-7cab0d05602e None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:28.732041 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff36bf68-b1b5-44e9-91ff-7cab0d05602e None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:28.732527 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff36bf68-b1b5-44e9-91ff-7cab0d05602e None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:28.735680 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 212/427] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:25:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:25:28.741688 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3234d8-9ea3-42d8-83aa-b3424dfb0141 None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:28.741983 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3234d8-9ea3-42d8-83aa-b3424dfb0141 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:28.742233 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3234d8-9ea3-42d8-83aa-b3424dfb0141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:28.764689 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-2c3234d8-9ea3-42d8-83aa-b3424dfb0141 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:25:28.765986 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-2c3234d8-9ea3-42d8-83aa-b3424dfb0141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:25:28.824494 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a096f9d7-8c47-4963-8e27-4f44e30122bc None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:28.826785 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:28.846830 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 213/428] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:25:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:25:28.871539 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2656f19d-aa55-4cd4-836b-d79fe3a3d330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:28.872460 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2656f19d-aa55-4cd4-836b-d79fe3a3d330 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:28.872899 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2656f19d-aa55-4cd4-836b-d79fe3a3d330 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:28.878525 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3234d8-9ea3-42d8-83aa-b3424dfb0141 None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:28.878705 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2656f19d-aa55-4cd4-836b-d79fe3a3d330 None admin] PATH_INFO: `/v3/roles` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:28.878705 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2656f19d-aa55-4cd4-836b-d79fe3a3d330 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:28.878705 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2656f19d-aa55-4cd4-836b-d79fe3a3d330 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:28.878705 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2656f19d-aa55-4cd4-836b-d79fe3a3d330 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:28.888044 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 216/429] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 15:25:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:28.894635 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2656f19d-aa55-4cd4-836b-d79fe3a3d330 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:28.899289 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:29.046488 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3234d8-9ea3-42d8-83aa-b3424dfb0141 None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:29.082374 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2656f19d-aa55-4cd4-836b-d79fe3a3d330 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:29.128262 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e880ac4a-a3a6-4d33-a3e1-62d1be746dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:29.129515 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880ac4a-a3a6-4d33-a3e1-62d1be746dff None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:29.131752 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880ac4a-a3a6-4d33-a3e1-62d1be746dff None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:29.132102 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880ac4a-a3a6-4d33-a3e1-62d1be746dff None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:29.141284 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cde25e-074d-4125-9aba-a8a36f8b7b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:29.142254 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cde25e-074d-4125-9aba-a8a36f8b7b05 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:29.147426 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cde25e-074d-4125-9aba-a8a36f8b7b05 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:29.147914 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cde25e-074d-4125-9aba-a8a36f8b7b05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:29.148142 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e880ac4a-a3a6-4d33-a3e1-62d1be746dff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:25:29.154229 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application [None req-e880ac4a-a3a6-4d33-a3e1-62d1be746dff None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 15:25:29.154229 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:25:29.154229 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:25:29.154229 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:25:29.154229 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:25:29.154229 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:25:29.154229 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:25:29.154229 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:25:29.154229 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:25:29.154229 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:25:29.154229 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:25:29.154229 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:25:29.154229 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:25:29.154229 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:25:29.154229 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:25:29.154229 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:25:29.155194 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:25:29.155194 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:25:29.155194 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:25:29.155194 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:25:29.155194 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:25:29.155194 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:25:29.155194 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:25:29.155194 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:25:29.155194 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:25:29.155194 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:25:29.155194 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:25:29.155194 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application with Lock( Jul 26 15:25:29.155194 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:25:29.155194 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:25:29.155194 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:25:29.155194 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:25:29.156001 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:25:29.156001 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:25:29.156001 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:25:29.156001 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:25:29.156001 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:25:29.156001 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:25:29.156001 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:25:29.156001 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:25:29.156001 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:25:29.156001 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:25:29.156001 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 15:25:29.156001 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:25:29.156821 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 214/430] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jul 26 15:25:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 15:25:29.165768 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e880ac4a-a3a6-4d33-a3e1-62d1be746dff None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:29.201139 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:29.290660 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cde25e-074d-4125-9aba-a8a36f8b7b05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:29.293788 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cde25e-074d-4125-9aba-a8a36f8b7b05 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:29.308427 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:29.345826 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e880ac4a-a3a6-4d33-a3e1-62d1be746dff None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:29.396070 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a327ade5-5cbc-42f1-a25e-928e9d6ecf11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:29.396697 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a327ade5-5cbc-42f1-a25e-928e9d6ecf11 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:29.396981 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a327ade5-5cbc-42f1-a25e-928e9d6ecf11 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:29.397256 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a327ade5-5cbc-42f1-a25e-928e9d6ecf11 None admin] PATH_INFO: `/v3/roles` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:29.397994 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a327ade5-5cbc-42f1-a25e-928e9d6ecf11 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:29.398303 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a327ade5-5cbc-42f1-a25e-928e9d6ecf11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:29.399744 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a327ade5-5cbc-42f1-a25e-928e9d6ecf11 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:29.415429 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 215/431] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 15:25:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:25:29.415429 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac70a0-58ee-4d7f-a432-4c1abd6141fd None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:29.415429 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac70a0-58ee-4d7f-a432-4c1abd6141fd None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:29.415429 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac70a0-58ee-4d7f-a432-4c1abd6141fd None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:29.415429 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 216/432] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:25:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:25:29.417517 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ac70a0-58ee-4d7f-a432-4c1abd6141fd None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:29.481444 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 217/433] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 15:25:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 587 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 15:25:29.484150 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2fb803-1014-4c76-830c-efff405a81aa None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:29.484904 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2fb803-1014-4c76-830c-efff405a81aa None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:29.485895 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2fb803-1014-4c76-830c-efff405a81aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:29.515852 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-0f2fb803-1014-4c76-830c-efff405a81aa None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:25:29.518205 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-0f2fb803-1014-4c76-830c-efff405a81aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:25:29.598275 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ac70a0-58ee-4d7f-a432-4c1abd6141fd None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:29.626757 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:29.642102 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 218/434] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:25:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:25:29.643748 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2fb803-1014-4c76-830c-efff405a81aa None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:29.672220 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111aab24-289e-4cce-a0a5-257aba7a6795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:29.674006 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111aab24-289e-4cce-a0a5-257aba7a6795 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:29.674530 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111aab24-289e-4cce-a0a5-257aba7a6795 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:29.674955 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111aab24-289e-4cce-a0a5-257aba7a6795 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:29.692004 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:29.768002 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111aab24-289e-4cce-a0a5-257aba7a6795 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:29.769479 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111aab24-289e-4cce-a0a5-257aba7a6795 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:29.805846 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2fb803-1014-4c76-830c-efff405a81aa None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:29.847329 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe58561-b50c-4aca-a620-667cd782c173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:29.847979 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe58561-b50c-4aca-a620-667cd782c173 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:29.848270 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe58561-b50c-4aca-a620-667cd782c173 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:29.848550 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe58561-b50c-4aca-a620-667cd782c173 None admin] PATH_INFO: `/v3/projects/e99ebc2f1eb141dc8c8555d0aea0cd1f` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:29.849744 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe58561-b50c-4aca-a620-667cd782c173 None admin] RBAC: Authorizing `identity:get_project(project_id=e99ebc2f1eb141dc8c8555d0aea0cd1f)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:29.851314 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe58561-b50c-4aca-a620-667cd782c173 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:29.853011 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 219/435] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 15:25:29 2022] GET /identity/v3/projects/e99ebc2f1eb141dc8c8555d0aea0cd1f => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:29.858389 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe58561-b50c-4aca-a620-667cd782c173 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:29.884336 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 217/436] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 15:25:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 15:25:29.885755 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869a223a-9e7b-478b-abde-a2a6e7dd6add None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:29.886041 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869a223a-9e7b-478b-abde-a2a6e7dd6add None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:29.886311 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869a223a-9e7b-478b-abde-a2a6e7dd6add None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:29.887937 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 218/437] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:25:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:25:29.888652 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869a223a-9e7b-478b-abde-a2a6e7dd6add None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:29.926329 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:29.939875 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:29.973296 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe58561-b50c-4aca-a620-667cd782c173 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:30.005294 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869a223a-9e7b-478b-abde-a2a6e7dd6add None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:30.014177 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54998d97-28a9-41c7-9633-2a386b0884a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:30.014840 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54998d97-28a9-41c7-9633-2a386b0884a4 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:30.015145 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54998d97-28a9-41c7-9633-2a386b0884a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:30.015429 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54998d97-28a9-41c7-9633-2a386b0884a4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:30.026301 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54998d97-28a9-41c7-9633-2a386b0884a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:25:30.031709 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-54998d97-28a9-41c7-9633-2a386b0884a4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 15:25:30.031709 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:25:30.031709 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:25:30.031709 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:25:30.031709 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:25:30.031709 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:25:30.031709 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:25:30.031709 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:25:30.031709 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:25:30.031709 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:25:30.031709 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:25:30.031709 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:25:30.031709 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:25:30.031709 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:25:30.031709 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:25:30.031709 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:25:30.032611 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:25:30.032611 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:25:30.032611 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:25:30.032611 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:25:30.032611 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:25:30.032611 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:25:30.032611 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:25:30.032611 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:25:30.032611 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:25:30.032611 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:25:30.032611 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:25:30.032611 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:25:30.032611 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:25:30.032611 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:25:30.032611 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:25:30.032611 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:25:30.033499 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:25:30.033499 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:25:30.033499 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:25:30.033499 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:25:30.033499 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:25:30.033499 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:25:30.033499 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:25:30.033499 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:25:30.033499 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:25:30.033499 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:25:30.033499 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 15:25:30.033499 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:25:30.033499 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 220/438] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 15:25:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:25:30.034156 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54998d97-28a9-41c7-9633-2a386b0884a4 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:30.049934 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e98fde-2194-415d-9f1c-d9a97023f29f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:30.050588 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e98fde-2194-415d-9f1c-d9a97023f29f None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:30.052098 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e98fde-2194-415d-9f1c-d9a97023f29f None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:30.052098 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e98fde-2194-415d-9f1c-d9a97023f29f None admin] PATH_INFO: `/v3/groups/5cdf3be8fcaa4c96b6acbc1e74944a30` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:30.052329 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e98fde-2194-415d-9f1c-d9a97023f29f None admin] RBAC: Authorizing `identity:get_group(group_id=5cdf3be8fcaa4c96b6acbc1e74944a30)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:30.053773 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e98fde-2194-415d-9f1c-d9a97023f29f None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:30.060425 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 219/439] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Jul 26 15:25:29 2022] GET /identity/v3/groups/5cdf3be8fcaa4c96b6acbc1e74944a30 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:30.060425 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa273be5-70ac-4f4d-a0ff-de3d8d058ada None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:30.060425 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa273be5-70ac-4f4d-a0ff-de3d8d058ada None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:30.060425 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa273be5-70ac-4f4d-a0ff-de3d8d058ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:30.077785 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-aa273be5-70ac-4f4d-a0ff-de3d8d058ada None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:25:30.079001 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-aa273be5-70ac-4f4d-a0ff-de3d8d058ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:25:30.145106 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54998d97-28a9-41c7-9633-2a386b0884a4 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:30.149964 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 220/440] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:25:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:25:30.150813 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa273be5-70ac-4f4d-a0ff-de3d8d058ada None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:30.171551 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:30.183672 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a4521-deb8-40a2-b069-95431d90fe00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:30.184322 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a4521-deb8-40a2-b069-95431d90fe00 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:30.184604 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a4521-deb8-40a2-b069-95431d90fe00 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:30.184884 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a4521-deb8-40a2-b069-95431d90fe00 None admin] PATH_INFO: `/v3/projects/24c3fa325d8a41dc8ac86599b7fb5180` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:30.186059 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034a4521-deb8-40a2-b069-95431d90fe00 None admin] RBAC: Authorizing `identity:get_project(project_id=24c3fa325d8a41dc8ac86599b7fb5180)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:30.187590 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034a4521-deb8-40a2-b069-95431d90fe00 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:30.189389 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 221/441] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 15:25:30 2022] GET /identity/v3/projects/24c3fa325d8a41dc8ac86599b7fb5180 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:30.192801 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a4521-deb8-40a2-b069-95431d90fe00 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:30.203061 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:30.261388 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa273be5-70ac-4f4d-a0ff-de3d8d058ada None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:30.306096 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ba56c0-ec2b-4371-acb3-833fefb0d2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:30.308155 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ba56c0-ec2b-4371-acb3-833fefb0d2ef None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:30.308155 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ba56c0-ec2b-4371-acb3-833fefb0d2ef None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:30.308155 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ba56c0-ec2b-4371-acb3-833fefb0d2ef None admin] PATH_INFO: `/v3/roles` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:30.308155 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ba56c0-ec2b-4371-acb3-833fefb0d2ef None admin] RBAC: Adding query filter params (name=member) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:30.308445 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ba56c0-ec2b-4371-acb3-833fefb0d2ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:30.309730 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ba56c0-ec2b-4371-acb3-833fefb0d2ef None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:30.310346 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a4521-deb8-40a2-b069-95431d90fe00 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:30.318535 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 221/442] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jul 26 15:25:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:30.319394 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ba56c0-ec2b-4371-acb3-833fefb0d2ef None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:30.346461 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3e53a8-39ff-48de-8e1b-c9082fe47c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:30.347096 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3e53a8-39ff-48de-8e1b-c9082fe47c3d None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:30.347890 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3e53a8-39ff-48de-8e1b-c9082fe47c3d None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:30.347890 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3e53a8-39ff-48de-8e1b-c9082fe47c3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:30.348507 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3e53a8-39ff-48de-8e1b-c9082fe47c3d None admin] RBAC: Adding query filter params (group.id=5cdf3be8fcaa4c96b6acbc1e74944a30, role.id=c86cdde38565431ebacf53dcfc4d863b, scope.project.id=e99ebc2f1eb141dc8c8555d0aea0cd1f) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:30.348824 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3e53a8-39ff-48de-8e1b-c9082fe47c3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:30.350314 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3e53a8-39ff-48de-8e1b-c9082fe47c3d None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:30.356896 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 222/443] 10.222.0.18 () {56 vars in 1376 bytes} [Tue Jul 26 15:25:30 2022] GET /identity/v3/role_assignments?group.id=5cdf3be8fcaa4c96b6acbc1e74944a30&scope.project.id=e99ebc2f1eb141dc8c8555d0aea0cd1f&role.id=c86cdde38565431ebacf53dcfc4d863b => generated 611 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:30.357743 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3e53a8-39ff-48de-8e1b-c9082fe47c3d None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:30.443389 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:30.474713 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ba56c0-ec2b-4371-acb3-833fefb0d2ef None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:30.477795 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:30.503364 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3e53a8-39ff-48de-8e1b-c9082fe47c3d None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:30.527430 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af0aa6-f8ee-4c8a-86ae-ee3b7c5dc400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:30.529124 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af0aa6-f8ee-4c8a-86ae-ee3b7c5dc400 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:30.529645 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af0aa6-f8ee-4c8a-86ae-ee3b7c5dc400 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:30.530081 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af0aa6-f8ee-4c8a-86ae-ee3b7c5dc400 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:30.542771 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57af0aa6-f8ee-4c8a-86ae-ee3b7c5dc400 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:25:30.549221 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application [None req-57af0aa6-f8ee-4c8a-86ae-ee3b7c5dc400 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 15:25:30.549221 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:25:30.549221 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:25:30.549221 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:25:30.549221 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:25:30.549221 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:25:30.549221 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:25:30.549221 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:25:30.549221 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:25:30.549221 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:25:30.549221 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:25:30.549221 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:25:30.549221 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:25:30.549221 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:25:30.549221 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:25:30.549221 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:25:30.550147 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:25:30.550147 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:25:30.550147 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:25:30.550147 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:25:30.550147 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:25:30.550147 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:25:30.550147 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:25:30.550147 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:25:30.550147 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:25:30.550147 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:25:30.550147 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:25:30.550147 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application with Lock( Jul 26 15:25:30.550147 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:25:30.550147 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:25:30.550147 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:25:30.550147 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:25:30.551268 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:25:30.551268 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:25:30.551268 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:25:30.551268 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:25:30.551268 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:25:30.551268 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:25:30.551268 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:25:30.551268 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:25:30.551268 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:25:30.551268 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:25:30.551268 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 15:25:30.551268 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:25:30.551268 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 222/444] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jul 26 15:25:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:25:30.551268 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af0aa6-f8ee-4c8a-86ae-ee3b7c5dc400 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:30.567831 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdcc62d-5af0-4872-a7bd-7e1dd8e6f569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:30.568109 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdcc62d-5af0-4872-a7bd-7e1dd8e6f569 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:30.568237 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdcc62d-5af0-4872-a7bd-7e1dd8e6f569 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:30.568578 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdcc62d-5af0-4872-a7bd-7e1dd8e6f569 None admin] PATH_INFO: `/v3/groups/5cdf3be8fcaa4c96b6acbc1e74944a30` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:30.569737 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdcc62d-5af0-4872-a7bd-7e1dd8e6f569 None admin] RBAC: Authorizing `identity:get_group(group_id=5cdf3be8fcaa4c96b6acbc1e74944a30)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:30.571267 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdcc62d-5af0-4872-a7bd-7e1dd8e6f569 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:30.573175 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 223/445] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Jul 26 15:25:30 2022] GET /identity/v3/groups/5cdf3be8fcaa4c96b6acbc1e74944a30 => generated 226 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:30.573711 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdcc62d-5af0-4872-a7bd-7e1dd8e6f569 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:30.703812 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af0aa6-f8ee-4c8a-86ae-ee3b7c5dc400 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:30.716283 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdcc62d-5af0-4872-a7bd-7e1dd8e6f569 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:30.745870 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:30.766621 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd5c9da-933c-445f-b110-caa05a465291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:30.767647 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd5c9da-933c-445f-b110-caa05a465291 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:30.768090 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd5c9da-933c-445f-b110-caa05a465291 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:30.768242 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8995ff-22bb-4103-a60c-e3c2b5477fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:30.768537 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd5c9da-933c-445f-b110-caa05a465291 None admin] PATH_INFO: `/v3/roles` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:30.769065 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8995ff-22bb-4103-a60c-e3c2b5477fc8 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:30.770662 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8995ff-22bb-4103-a60c-e3c2b5477fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:30.772783 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd5c9da-933c-445f-b110-caa05a465291 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:30.772963 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8995ff-22bb-4103-a60c-e3c2b5477fc8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:30.773121 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd5c9da-933c-445f-b110-caa05a465291 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:30.773121 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd5c9da-933c-445f-b110-caa05a465291 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:30.791165 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 224/446] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 15:25:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:30.791165 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd5c9da-933c-445f-b110-caa05a465291 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:30.828128 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:30.882450 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8995ff-22bb-4103-a60c-e3c2b5477fc8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:30.884154 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8995ff-22bb-4103-a60c-e3c2b5477fc8 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:30.934851 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd5c9da-933c-445f-b110-caa05a465291 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:30.972498 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fc03ad-2210-46c2-8774-e44ab1be9f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:30.973121 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc03ad-2210-46c2-8774-e44ab1be9f36 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:30.973409 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc03ad-2210-46c2-8774-e44ab1be9f36 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:30.973682 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc03ad-2210-46c2-8774-e44ab1be9f36 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:30.974497 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fc03ad-2210-46c2-8774-e44ab1be9f36 None admin] RBAC: Adding query filter params (group.id=5cdf3be8fcaa4c96b6acbc1e74944a30, role.id=c86cdde38565431ebacf53dcfc4d863b, scope.project.id=24c3fa325d8a41dc8ac86599b7fb5180) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:30.974804 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fc03ad-2210-46c2-8774-e44ab1be9f36 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:30.976321 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fc03ad-2210-46c2-8774-e44ab1be9f36 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:30.983267 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 225/447] 10.222.0.18 () {56 vars in 1376 bytes} [Tue Jul 26 15:25:30 2022] GET /identity/v3/role_assignments?group.id=5cdf3be8fcaa4c96b6acbc1e74944a30&scope.project.id=24c3fa325d8a41dc8ac86599b7fb5180&role.id=c86cdde38565431ebacf53dcfc4d863b => generated 611 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:30.984301 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fc03ad-2210-46c2-8774-e44ab1be9f36 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:31.046634 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 223/448] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 15:25:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 15:25:31.052496 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8995ff-22bb-4103-a60c-e3c2b5477fc8 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:31.062320 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:31.150299 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fc03ad-2210-46c2-8774-e44ab1be9f36 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:31.159161 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:31.203914 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e23c899-4370-4b49-a021-0f8c9414fb8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:31.204575 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23c899-4370-4b49-a021-0f8c9414fb8b None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:31.204857 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23c899-4370-4b49-a021-0f8c9414fb8b None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:31.205188 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23c899-4370-4b49-a021-0f8c9414fb8b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:31.231103 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8995ff-22bb-4103-a60c-e3c2b5477fc8 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:31.285168 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21bc0c1-bb6b-45fb-b525-7ef7d61f3705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:31.291962 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21bc0c1-bb6b-45fb-b525-7ef7d61f3705 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:31.291962 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21bc0c1-bb6b-45fb-b525-7ef7d61f3705 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:31.291962 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21bc0c1-bb6b-45fb-b525-7ef7d61f3705 None admin] PATH_INFO: `/v3/projects/24c3fa325d8a41dc8ac86599b7fb5180` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:31.294986 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21bc0c1-bb6b-45fb-b525-7ef7d61f3705 None admin] RBAC: Authorizing `identity:get_project(project_id=24c3fa325d8a41dc8ac86599b7fb5180)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:31.295754 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21bc0c1-bb6b-45fb-b525-7ef7d61f3705 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:31.297700 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 224/449] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 15:25:31 2022] GET /identity/v3/projects/24c3fa325d8a41dc8ac86599b7fb5180 => generated 302 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:25:31.306078 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21bc0c1-bb6b-45fb-b525-7ef7d61f3705 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:31.316482 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e23c899-4370-4b49-a021-0f8c9414fb8b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:31.320460 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e23c899-4370-4b49-a021-0f8c9414fb8b None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:31.381566 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:31.440210 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21bc0c1-bb6b-45fb-b525-7ef7d61f3705 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:31.460347 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 226/450] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 15:25:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 15:25:31.467888 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e23c899-4370-4b49-a021-0f8c9414fb8b None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:31.484035 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:31.491191 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeb8454-451a-487e-beb5-8e69be60ca8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:31.491961 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb8454-451a-487e-beb5-8e69be60ca8d None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:31.496323 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb8454-451a-487e-beb5-8e69be60ca8d None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:31.496323 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb8454-451a-487e-beb5-8e69be60ca8d None admin] PATH_INFO: `/v3/groups/5cdf3be8fcaa4c96b6acbc1e74944a30` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:31.496323 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeb8454-451a-487e-beb5-8e69be60ca8d None admin] RBAC: Authorizing `identity:get_group(group_id=5cdf3be8fcaa4c96b6acbc1e74944a30)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:31.496323 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeb8454-451a-487e-beb5-8e69be60ca8d None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:31.497994 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 225/451] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Jul 26 15:25:31 2022] GET /identity/v3/groups/5cdf3be8fcaa4c96b6acbc1e74944a30 => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:25:31.507057 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeb8454-451a-487e-beb5-8e69be60ca8d None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:31.601934 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e23c899-4370-4b49-a021-0f8c9414fb8b None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:31.649956 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeb8454-451a-487e-beb5-8e69be60ca8d None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:31.657233 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d24d5e9-a2b4-4e79-9129-f8897fe5c998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:31.658287 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d24d5e9-a2b4-4e79-9129-f8897fe5c998 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:31.658735 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d24d5e9-a2b4-4e79-9129-f8897fe5c998 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:31.659224 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d24d5e9-a2b4-4e79-9129-f8897fe5c998 None admin] PATH_INFO: `/v3/projects/1316e00006b74e70a667f12420c63a2c` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:31.661102 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d24d5e9-a2b4-4e79-9129-f8897fe5c998 None admin] RBAC: Authorizing `identity:get_project(project_id=1316e00006b74e70a667f12420c63a2c)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:31.663549 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d24d5e9-a2b4-4e79-9129-f8897fe5c998 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:31.666494 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 227/452] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 15:25:31 2022] GET /identity/v3/projects/1316e00006b74e70a667f12420c63a2c => generated 344 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:25:31.673265 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d24d5e9-a2b4-4e79-9129-f8897fe5c998 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:31.698884 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:31.700422 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8bacbe-49ee-4095-960c-79b78d4252b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:31.701320 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8bacbe-49ee-4095-960c-79b78d4252b0 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:31.701661 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8bacbe-49ee-4095-960c-79b78d4252b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:31.701995 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8bacbe-49ee-4095-960c-79b78d4252b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:31.702914 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8bacbe-49ee-4095-960c-79b78d4252b0 None admin] RBAC: Adding query filter params (group.id=5cdf3be8fcaa4c96b6acbc1e74944a30, role.id=fd8f80bccab248edbb1d09ec187a8113, scope.project.id=24c3fa325d8a41dc8ac86599b7fb5180) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:31.703334 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8bacbe-49ee-4095-960c-79b78d4252b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:31.705110 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8bacbe-49ee-4095-960c-79b78d4252b0 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:31.712578 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 226/453] 10.222.0.18 () {56 vars in 1376 bytes} [Tue Jul 26 15:25:31 2022] GET /identity/v3/role_assignments?group.id=5cdf3be8fcaa4c96b6acbc1e74944a30&scope.project.id=24c3fa325d8a41dc8ac86599b7fb5180&role.id=fd8f80bccab248edbb1d09ec187a8113 => generated 611 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:25:31.808014 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d24d5e9-a2b4-4e79-9129-f8897fe5c998 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:31.849644 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be1e37-9c5c-494c-82e3-9a92e8b0e9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:31.850388 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be1e37-9c5c-494c-82e3-9a92e8b0e9c3 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:31.850734 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be1e37-9c5c-494c-82e3-9a92e8b0e9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:31.851075 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be1e37-9c5c-494c-82e3-9a92e8b0e9c3 None admin] PATH_INFO: `/v3/groups/4a49c95bf0bb4d5788ac3ee8bb35f89e` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:31.852444 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0be1e37-9c5c-494c-82e3-9a92e8b0e9c3 None admin] RBAC: Authorizing `identity:get_group(group_id=4a49c95bf0bb4d5788ac3ee8bb35f89e)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:31.854030 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0be1e37-9c5c-494c-82e3-9a92e8b0e9c3 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:31.855853 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 228/454] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Jul 26 15:25:31 2022] GET /identity/v3/groups/4a49c95bf0bb4d5788ac3ee8bb35f89e => generated 229 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:25:31.865228 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8bacbe-49ee-4095-960c-79b78d4252b0 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:31.943117 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:31.995903 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8bacbe-49ee-4095-960c-79b78d4252b0 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:32.047696 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f1bf7e-bcf0-4bf1-8083-7fe4a45c94c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:32.048534 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f1bf7e-bcf0-4bf1-8083-7fe4a45c94c1 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:32.048984 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f1bf7e-bcf0-4bf1-8083-7fe4a45c94c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:32.049327 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f1bf7e-bcf0-4bf1-8083-7fe4a45c94c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:32.050214 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f1bf7e-bcf0-4bf1-8083-7fe4a45c94c1 None admin] RBAC: Adding query filter params (group.id=4a49c95bf0bb4d5788ac3ee8bb35f89e, role.id=2c659645e15c4204b1457556939397cb, scope.project.id=1316e00006b74e70a667f12420c63a2c) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:32.050572 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f1bf7e-bcf0-4bf1-8083-7fe4a45c94c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:32.052501 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f1bf7e-bcf0-4bf1-8083-7fe4a45c94c1 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:32.060866 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 227/455] 10.222.0.18 () {56 vars in 1376 bytes} [Tue Jul 26 15:25:31 2022] GET /identity/v3/role_assignments?group.id=4a49c95bf0bb4d5788ac3ee8bb35f89e&scope.project.id=1316e00006b74e70a667f12420c63a2c&role.id=2c659645e15c4204b1457556939397cb => generated 611 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:35.002481 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e79f5e-6698-4a21-9f2d-fca80e018679 None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:35.003073 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e79f5e-6698-4a21-9f2d-fca80e018679 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:35.003507 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e79f5e-6698-4a21-9f2d-fca80e018679 None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:35.006839 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 229/456] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:25:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:25:35.015158 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c8df6-d69d-46d6-a04a-357bb31e2d09 None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:35.015158 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c8df6-d69d-46d6-a04a-357bb31e2d09 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:35.015158 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c8df6-d69d-46d6-a04a-357bb31e2d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:35.043117 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-102c8df6-d69d-46d6-a04a-357bb31e2d09 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:25:35.046297 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-102c8df6-d69d-46d6-a04a-357bb31e2d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:25:35.185543 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 228/457] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:25:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 15:25:35.210734 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e79f5e-6698-4a21-9f2d-fca80e018679 None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:35.312817 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:35.331860 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e79f5e-6698-4a21-9f2d-fca80e018679 None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:35.376459 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a31fe33-61c7-4b18-8928-9214d01096a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:35.377189 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a31fe33-61c7-4b18-8928-9214d01096a8 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:35.377480 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a31fe33-61c7-4b18-8928-9214d01096a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:35.377762 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a31fe33-61c7-4b18-8928-9214d01096a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:35.390751 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a31fe33-61c7-4b18-8928-9214d01096a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:35.392500 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a31fe33-61c7-4b18-8928-9214d01096a8 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:35.409993 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-1a31fe33-61c7-4b18-8928-9214d01096a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:25:35.409993 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:25:35.409993 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:25:35.409993 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:25:35.409993 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:25:35.409993 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:25:35.409993 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:25:35.409993 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:25:35.409993 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:25:35.409993 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:25:35.409993 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:25:35.409993 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:25:35.409993 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:25:35.409993 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:25:35.409993 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:25:35.410921 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:25:35.410921 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:25:35.410921 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:25:35.410921 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:25:35.410921 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:25:35.410921 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:25:35.410921 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:25:35.410921 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:25:35.410921 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:25:35.410921 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:25:35.410921 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:25:35.410921 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:25:35.410921 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:25:35.410921 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:25:35.410921 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:25:35.410921 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:25:35.410921 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:25:35.411803 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:25:35.411803 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:25:35.411803 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:25:35.411803 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:25:35.411803 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 230/458] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 15:25:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:25:35.418753 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102c8df6-d69d-46d6-a04a-357bb31e2d09 None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:35.503452 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:35.515346 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f8d93-8e43-41ac-a209-c6d9f1f40bfc None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:35.515989 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f8d93-8e43-41ac-a209-c6d9f1f40bfc None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:35.516587 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f8d93-8e43-41ac-a209-c6d9f1f40bfc None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:35.519690 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 231/459] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:25:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 15:25:35.524546 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e720067a-c721-4913-bb79-0473cd05eb6a None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:35.525125 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e720067a-c721-4913-bb79-0473cd05eb6a None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:35.532443 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e720067a-c721-4913-bb79-0473cd05eb6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:35.546296 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-e720067a-c721-4913-bb79-0473cd05eb6a None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:25:35.547907 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-e720067a-c721-4913-bb79-0473cd05eb6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:25:35.561843 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102c8df6-d69d-46d6-a04a-357bb31e2d09 None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:35.601216 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa78b1ab-bb30-40ad-b3b8-dfca1708c4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:35.601858 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa78b1ab-bb30-40ad-b3b8-dfca1708c4b3 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:35.602142 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa78b1ab-bb30-40ad-b3b8-dfca1708c4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:35.602420 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa78b1ab-bb30-40ad-b3b8-dfca1708c4b3 None admin] PATH_INFO: `/v3/domains` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:35.603161 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa78b1ab-bb30-40ad-b3b8-dfca1708c4b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:35.603493 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa78b1ab-bb30-40ad-b3b8-dfca1708c4b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:35.604926 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa78b1ab-bb30-40ad-b3b8-dfca1708c4b3 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:35.625778 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 229/460] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 15:25:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:35.630105 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 232/461] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:25:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 15:25:35.635171 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa78b1ab-bb30-40ad-b3b8-dfca1708c4b3 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:35.658330 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e720067a-c721-4913-bb79-0473cd05eb6a None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:35.740930 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:35.747711 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa78b1ab-bb30-40ad-b3b8-dfca1708c4b3 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:35.771363 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:35.783921 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e720067a-c721-4913-bb79-0473cd05eb6a None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:35.786969 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffad7936-e513-46c3-b1e3-1917d90d8e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:35.788341 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad7936-e513-46c3-b1e3-1917d90d8e99 None admin] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:35.788341 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad7936-e513-46c3-b1e3-1917d90d8e99 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:35.788341 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad7936-e513-46c3-b1e3-1917d90d8e99 None admin] PATH_INFO: `/v3/users` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:35.794672 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffad7936-e513-46c3-b1e3-1917d90d8e99 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:35.794672 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffad7936-e513-46c3-b1e3-1917d90d8e99 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:35.828603 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dc6dd5-5e3c-4fda-90e0-d6157526bd01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:35.829620 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc6dd5-5e3c-4fda-90e0-d6157526bd01 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:35.830124 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc6dd5-5e3c-4fda-90e0-d6157526bd01 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:35.830587 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc6dd5-5e3c-4fda-90e0-d6157526bd01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:35.845682 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dc6dd5-5e3c-4fda-90e0-d6157526bd01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:35.847600 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dc6dd5-5e3c-4fda-90e0-d6157526bd01 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:35.866479 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-f5dc6dd5-5e3c-4fda-90e0-d6157526bd01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:25:35.866479 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:25:35.866479 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:25:35.866479 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:25:35.866479 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:25:35.866479 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:25:35.866479 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:25:35.866479 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:25:35.866479 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:25:35.866479 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:25:35.866479 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:25:35.866479 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:25:35.866479 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:25:35.866479 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:25:35.866479 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:25:35.867573 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:25:35.867573 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:25:35.867573 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:25:35.867573 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:25:35.867573 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:25:35.867573 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:25:35.867573 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:25:35.867573 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:25:35.867573 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:25:35.867573 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:25:35.867573 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:25:35.867573 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:25:35.867573 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:25:35.867573 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:25:35.867573 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:25:35.867573 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:25:35.867573 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:25:35.868431 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:25:35.868431 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:25:35.868431 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:25:35.868431 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:25:35.868726 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 233/462] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 15:25:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 15:25:35.876119 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dc6dd5-5e3c-4fda-90e0-d6157526bd01 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:35.935540 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 230/463] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Jul 26 15:25:35 2022] POST /identity/v3/users => generated 246 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:25:36.022279 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dc6dd5-5e3c-4fda-90e0-d6157526bd01 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:36.046434 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:36.068254 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb1182e-c5e7-4ed2-93ba-8a845f8a3c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:36.069292 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb1182e-c5e7-4ed2-93ba-8a845f8a3c34 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:36.069763 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb1182e-c5e7-4ed2-93ba-8a845f8a3c34 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:36.070235 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb1182e-c5e7-4ed2-93ba-8a845f8a3c34 None admin] PATH_INFO: `/v3/domains` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:36.071240 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb1182e-c5e7-4ed2-93ba-8a845f8a3c34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:36.071760 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb1182e-c5e7-4ed2-93ba-8a845f8a3c34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:36.073437 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb1182e-c5e7-4ed2-93ba-8a845f8a3c34 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:36.093689 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 234/464] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 15:25:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:25:36.096356 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffad7936-e513-46c3-b1e3-1917d90d8e99 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:36.132647 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ff353-d26f-490d-b90d-842ad71eefb7 None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:36.132922 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ff353-d26f-490d-b90d-842ad71eefb7 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:36.133158 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ff353-d26f-490d-b90d-842ad71eefb7 None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:36.134849 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 235/465] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:25:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 15:25:36.140591 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f82e5ad-cf7a-4154-bf85-ac34b42b4bce None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:36.140922 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f82e5ad-cf7a-4154-bf85-ac34b42b4bce None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:36.141979 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f82e5ad-cf7a-4154-bf85-ac34b42b4bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:36.160854 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-8f82e5ad-cf7a-4154-bf85-ac34b42b4bce None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:25:36.162304 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-8f82e5ad-cf7a-4154-bf85-ac34b42b4bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:25:36.239585 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffad7936-e513-46c3-b1e3-1917d90d8e99 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:36.278877 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 236/466] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:25:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 15:25:36.294626 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9b532e-4f90-4256-bf4f-c94dae731be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:36.295659 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b532e-4f90-4256-bf4f-c94dae731be9 None admin] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:36.296128 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b532e-4f90-4256-bf4f-c94dae731be9 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:36.296611 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b532e-4f90-4256-bf4f-c94dae731be9 None admin] PATH_INFO: `/v3/users` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:36.297575 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9b532e-4f90-4256-bf4f-c94dae731be9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:36.299311 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9b532e-4f90-4256-bf4f-c94dae731be9 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:36.304781 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f82e5ad-cf7a-4154-bf85-ac34b42b4bce None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:36.395555 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 231/467] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Jul 26 15:25:36 2022] POST /identity/v3/users => generated 249 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:25:36.440934 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f82e5ad-cf7a-4154-bf85-ac34b42b4bce None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:36.452340 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:36.482808 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebc6738-e433-4144-acf5-7fede3944177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:36.483591 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc6738-e433-4144-acf5-7fede3944177 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:36.483880 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc6738-e433-4144-acf5-7fede3944177 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:36.484146 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc6738-e433-4144-acf5-7fede3944177 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:36.496344 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebc6738-e433-4144-acf5-7fede3944177 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:36.499556 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebc6738-e433-4144-acf5-7fede3944177 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:36.517258 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-9ebc6738-e433-4144-acf5-7fede3944177 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:25:36.517258 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:25:36.517258 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:25:36.517258 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:25:36.517258 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:25:36.517258 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:25:36.517258 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:25:36.517258 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:25:36.517258 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:25:36.517258 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:25:36.517258 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:25:36.517258 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:25:36.517258 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:25:36.517258 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:25:36.517258 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:25:36.518183 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:25:36.518183 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:25:36.518183 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:25:36.518183 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:25:36.518183 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:25:36.518183 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:25:36.518183 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:25:36.518183 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:25:36.518183 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:25:36.518183 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:25:36.518183 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:25:36.518183 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:25:36.518183 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:25:36.518183 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:25:36.518183 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:25:36.518183 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:25:36.518183 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:25:36.519487 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:25:36.519487 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:25:36.519487 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:25:36.519487 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:25:36.519487 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 237/468] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 15:25:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 15:25:36.525102 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9b532e-4f90-4256-bf4f-c94dae731be9 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:36.562858 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:36.649507 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9b532e-4f90-4256-bf4f-c94dae731be9 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:36.664033 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b617f-ad83-4c02-9f5c-a6d8a94424b1 None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:36.664525 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b617f-ad83-4c02-9f5c-a6d8a94424b1 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:36.665012 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b617f-ad83-4c02-9f5c-a6d8a94424b1 None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:36.674379 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 238/469] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:25:36 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 15:25:36.677085 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1afdcfa-a0e1-42d0-8c6c-0fdcb0ef3ab2 None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:36.677584 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1afdcfa-a0e1-42d0-8c6c-0fdcb0ef3ab2 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:36.678068 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1afdcfa-a0e1-42d0-8c6c-0fdcb0ef3ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:36.689596 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92e3f8e-fef0-4367-b000-5ecdf5418424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:36.690375 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e3f8e-fef0-4367-b000-5ecdf5418424 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:36.690657 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e3f8e-fef0-4367-b000-5ecdf5418424 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:36.690934 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e3f8e-fef0-4367-b000-5ecdf5418424 None admin] PATH_INFO: `/v3/domains` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:36.691792 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92e3f8e-fef0-4367-b000-5ecdf5418424 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:36.692101 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92e3f8e-fef0-4367-b000-5ecdf5418424 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:36.693546 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92e3f8e-fef0-4367-b000-5ecdf5418424 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:36.708420 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 232/470] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 15:25:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:36.711019 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-f1afdcfa-a0e1-42d0-8c6c-0fdcb0ef3ab2 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:25:36.713328 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-f1afdcfa-a0e1-42d0-8c6c-0fdcb0ef3ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:25:36.714304 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92e3f8e-fef0-4367-b000-5ecdf5418424 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:36.830836 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:36.850300 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92e3f8e-fef0-4367-b000-5ecdf5418424 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:36.868798 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 239/471] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:25:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 15:25:36.920342 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1afdcfa-a0e1-42d0-8c6c-0fdcb0ef3ab2 None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:36.932404 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e70b48-a8a5-4cfa-a1ef-06ca59182ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:36.933449 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e70b48-a8a5-4cfa-a1ef-06ca59182ad2 None admin] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:36.936938 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e70b48-a8a5-4cfa-a1ef-06ca59182ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:36.938306 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e70b48-a8a5-4cfa-a1ef-06ca59182ad2 None admin] PATH_INFO: `/v3/users` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:36.940311 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e70b48-a8a5-4cfa-a1ef-06ca59182ad2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:36.943692 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e70b48-a8a5-4cfa-a1ef-06ca59182ad2 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:37.057192 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:37.071203 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 233/472] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Jul 26 15:25:36 2022] POST /identity/v3/users => generated 248 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:25:37.079938 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1afdcfa-a0e1-42d0-8c6c-0fdcb0ef3ab2 None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:37.161996 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca0834d-c3a4-4c57-9c82-25963c59ab92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:37.163528 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca0834d-c3a4-4c57-9c82-25963c59ab92 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:37.164283 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca0834d-c3a4-4c57-9c82-25963c59ab92 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:37.165025 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca0834d-c3a4-4c57-9c82-25963c59ab92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:37.188038 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca0834d-c3a4-4c57-9c82-25963c59ab92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:37.191085 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca0834d-c3a4-4c57-9c82-25963c59ab92 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:37.223705 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-3ca0834d-c3a4-4c57-9c82-25963c59ab92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:25:37.223705 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:25:37.223705 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:25:37.223705 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:25:37.223705 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:25:37.223705 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:25:37.223705 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:25:37.223705 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:25:37.223705 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:25:37.223705 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:25:37.223705 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:25:37.223705 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:25:37.223705 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:25:37.223705 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:25:37.223705 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:25:37.225617 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:25:37.225617 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:25:37.225617 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:25:37.225617 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:25:37.225617 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:25:37.225617 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:25:37.225617 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:25:37.225617 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:25:37.225617 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:25:37.225617 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:25:37.225617 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:25:37.225617 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:25:37.225617 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:25:37.225617 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:25:37.225617 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:25:37.225617 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:25:37.225617 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:25:37.227590 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:25:37.227590 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:25:37.227590 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:25:37.227590 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:25:37.230472 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 240/473] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 15:25:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 15:25:37.241198 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e70b48-a8a5-4cfa-a1ef-06ca59182ad2 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:37.398265 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e70b48-a8a5-4cfa-a1ef-06ca59182ad2 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:37.438971 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1ef86b-66d3-4ec8-94ef-9bff8f22373d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:37.439554 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1ef86b-66d3-4ec8-94ef-9bff8f22373d None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:37.439824 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1ef86b-66d3-4ec8-94ef-9bff8f22373d None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:37.440106 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1ef86b-66d3-4ec8-94ef-9bff8f22373d None admin] PATH_INFO: `/v3/domains` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:37.440828 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1ef86b-66d3-4ec8-94ef-9bff8f22373d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:37.441138 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1ef86b-66d3-4ec8-94ef-9bff8f22373d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:37.442551 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1ef86b-66d3-4ec8-94ef-9bff8f22373d None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:37.460830 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 234/474] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 15:25:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:37.469140 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca0834d-c3a4-4c57-9c82-25963c59ab92 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:37.624821 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca0834d-c3a4-4c57-9c82-25963c59ab92 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:37.666663 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b0eb6c-1c85-4a2e-b4dd-aa4c49106102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:37.667453 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b0eb6c-1c85-4a2e-b4dd-aa4c49106102 None admin] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:37.667742 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b0eb6c-1c85-4a2e-b4dd-aa4c49106102 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:37.668116 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b0eb6c-1c85-4a2e-b4dd-aa4c49106102 None admin] PATH_INFO: `/v3/users` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:37.669916 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b0eb6c-1c85-4a2e-b4dd-aa4c49106102 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:37.672654 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b0eb6c-1c85-4a2e-b4dd-aa4c49106102 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:37.940600 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:37.953976 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 241/475] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Jul 26 15:25:37 2022] POST /identity/v3/users => generated 248 bytes in 485 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:25:39.207705 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610043e-a983-4b8b-97da-9539f36e85b2 None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:39.208547 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610043e-a983-4b8b-97da-9539f36e85b2 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:39.208680 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610043e-a983-4b8b-97da-9539f36e85b2 None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:39.212003 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 235/476] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:25:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:25:39.220322 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6fd4cd-0fa7-4651-80c5-447a7b2bbb94 None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:39.221080 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6fd4cd-0fa7-4651-80c5-447a7b2bbb94 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:39.221080 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6fd4cd-0fa7-4651-80c5-447a7b2bbb94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:39.252932 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-3f6fd4cd-0fa7-4651-80c5-447a7b2bbb94 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:25:39.254859 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-3f6fd4cd-0fa7-4651-80c5-447a7b2bbb94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:25:39.369060 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 242/477] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:25:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:25:39.395467 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1610043e-a983-4b8b-97da-9539f36e85b2 None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:39.400653 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:39.530928 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1610043e-a983-4b8b-97da-9539f36e85b2 None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:39.571930 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03044d47-da1f-4697-8d29-3d5b80917f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:39.572877 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03044d47-da1f-4697-8d29-3d5b80917f78 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:39.573308 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03044d47-da1f-4697-8d29-3d5b80917f78 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:39.573770 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03044d47-da1f-4697-8d29-3d5b80917f78 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:39.586973 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03044d47-da1f-4697-8d29-3d5b80917f78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:25:39.593095 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application [None req-03044d47-da1f-4697-8d29-3d5b80917f78 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 15:25:39.593095 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:25:39.593095 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:25:39.593095 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:25:39.593095 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:25:39.593095 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:25:39.593095 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:25:39.593095 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:25:39.593095 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:25:39.593095 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:25:39.593095 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:25:39.593095 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:25:39.593095 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:25:39.593095 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:25:39.593095 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:25:39.593095 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:25:39.594215 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:25:39.594215 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:25:39.594215 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:25:39.594215 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:25:39.594215 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:25:39.594215 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:25:39.594215 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:25:39.594215 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:25:39.594215 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:25:39.594215 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:25:39.594215 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:25:39.594215 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application with Lock( Jul 26 15:25:39.594215 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:25:39.594215 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:25:39.594215 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:25:39.594215 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:25:39.595207 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:25:39.595207 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:25:39.595207 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:25:39.595207 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:25:39.595207 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:25:39.595207 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:25:39.595207 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:25:39.595207 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:25:39.595207 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:25:39.595207 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:25:39.595207 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 15:25:39.595207 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:25:39.597521 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 236/478] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jul 26 15:25:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:25:39.603626 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6fd4cd-0fa7-4651-80c5-447a7b2bbb94 None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:39.673113 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d334f-fc98-43eb-b985-05c2f14d4a93 None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:39.673787 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d334f-fc98-43eb-b985-05c2f14d4a93 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:39.674273 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d334f-fc98-43eb-b985-05c2f14d4a93 None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:39.675861 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 237/479] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:25:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 15:25:39.682458 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5138f7d6-4b1d-495d-add9-773372bef58f None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:39.682767 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5138f7d6-4b1d-495d-add9-773372bef58f None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:39.683022 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5138f7d6-4b1d-495d-add9-773372bef58f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:39.702853 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-5138f7d6-4b1d-495d-add9-773372bef58f None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:25:39.704112 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-5138f7d6-4b1d-495d-add9-773372bef58f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:25:39.756706 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6fd4cd-0fa7-4651-80c5-447a7b2bbb94 None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:39.786984 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:39.795394 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35a8c0c-80bc-4b8a-9d25-68350c6b4742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:39.796020 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a8c0c-80bc-4b8a-9d25-68350c6b4742 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:39.796304 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a8c0c-80bc-4b8a-9d25-68350c6b4742 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:39.796582 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a8c0c-80bc-4b8a-9d25-68350c6b4742 None admin] PATH_INFO: `/v3/roles` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:39.799209 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35a8c0c-80bc-4b8a-9d25-68350c6b4742 None admin] RBAC: Adding query filter params (name=service) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:39.799209 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35a8c0c-80bc-4b8a-9d25-68350c6b4742 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:39.799209 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35a8c0c-80bc-4b8a-9d25-68350c6b4742 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:39.807583 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:39.816669 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 243/480] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jul 26 15:25:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:39.816669 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d1978-c52b-4abd-8779-4e43c9376fd6 None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:39.816669 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d1978-c52b-4abd-8779-4e43c9376fd6 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:39.816669 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d1978-c52b-4abd-8779-4e43c9376fd6 None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:39.816669 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 244/481] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:25:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:25:39.820782 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28d1978-c52b-4abd-8779-4e43c9376fd6 None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:39.827562 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 238/482] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:25:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 15:25:39.829115 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a81b38-dc22-4968-bd26-494b01ec5304 None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:39.829578 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a81b38-dc22-4968-bd26-494b01ec5304 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:39.830018 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a81b38-dc22-4968-bd26-494b01ec5304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:39.856438 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-09a81b38-dc22-4968-bd26-494b01ec5304 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:25:39.857839 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-09a81b38-dc22-4968-bd26-494b01ec5304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:25:39.958154 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 239/483] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:25:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:25:39.958940 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a81b38-dc22-4968-bd26-494b01ec5304 None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:39.987661 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28d1978-c52b-4abd-8779-4e43c9376fd6 None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:40.054493 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86b4104-2a64-41f9-8822-2eb1ea211d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:40.056062 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86b4104-2a64-41f9-8822-2eb1ea211d19 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:40.056537 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86b4104-2a64-41f9-8822-2eb1ea211d19 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:40.057020 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86b4104-2a64-41f9-8822-2eb1ea211d19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:40.071517 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86b4104-2a64-41f9-8822-2eb1ea211d19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:40.073432 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86b4104-2a64-41f9-8822-2eb1ea211d19 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:40.090577 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a81b38-dc22-4968-bd26-494b01ec5304 None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:40.092714 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-a86b4104-2a64-41f9-8822-2eb1ea211d19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:25:40.092714 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:25:40.092714 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:25:40.092714 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:25:40.092714 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:25:40.092714 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:25:40.092714 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:25:40.092714 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:25:40.092714 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:25:40.092714 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:25:40.092714 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:25:40.092714 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:25:40.092714 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:25:40.092714 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:25:40.092714 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:25:40.093594 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:25:40.093594 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:25:40.093594 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:25:40.093594 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:25:40.093594 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:25:40.093594 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:25:40.093594 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:25:40.093594 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:25:40.093594 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:25:40.093594 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:25:40.093594 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:25:40.093594 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:25:40.093594 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:25:40.093594 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:25:40.093594 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:25:40.093594 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:25:40.093594 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:25:40.094563 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:25:40.094563 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:25:40.094563 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:25:40.094563 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:25:40.096120 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 245/484] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 15:25:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 15:25:40.097115 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86b4104-2a64-41f9-8822-2eb1ea211d19 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:40.140104 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:40.157862 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f422aec2-3c91-4aa5-82d1-74f210f40a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:40.158519 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422aec2-3c91-4aa5-82d1-74f210f40a79 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:40.158800 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422aec2-3c91-4aa5-82d1-74f210f40a79 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:40.159302 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:40.159483 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422aec2-3c91-4aa5-82d1-74f210f40a79 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:40.177843 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f422aec2-3c91-4aa5-82d1-74f210f40a79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:25:40.183199 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application [None req-f422aec2-3c91-4aa5-82d1-74f210f40a79 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 15:25:40.183199 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:25:40.183199 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:25:40.183199 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:25:40.183199 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:25:40.183199 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:25:40.183199 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:25:40.183199 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:25:40.183199 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:25:40.183199 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:25:40.183199 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:25:40.183199 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:25:40.183199 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:25:40.183199 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:25:40.183199 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:25:40.183199 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:25:40.184907 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:25:40.184907 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:25:40.184907 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:25:40.184907 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:25:40.184907 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:25:40.184907 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:25:40.184907 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:25:40.184907 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:25:40.184907 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:25:40.184907 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:25:40.184907 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:25:40.184907 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application with Lock( Jul 26 15:25:40.184907 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:25:40.184907 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:25:40.184907 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:25:40.184907 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:25:40.185977 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:25:40.185977 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:25:40.185977 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:25:40.185977 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:25:40.185977 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:25:40.185977 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:25:40.185977 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:25:40.185977 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:25:40.185977 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:25:40.185977 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:25:40.185977 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 15:25:40.185977 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:25:40.185977 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 240/485] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jul 26 15:25:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:25:40.185977 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f422aec2-3c91-4aa5-82d1-74f210f40a79 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:40.247165 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86b4104-2a64-41f9-8822-2eb1ea211d19 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:40.302964 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76853a1a-d71b-48ae-91bb-2f71b7af1afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:40.304039 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76853a1a-d71b-48ae-91bb-2f71b7af1afb None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:40.304319 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76853a1a-d71b-48ae-91bb-2f71b7af1afb None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:40.304671 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76853a1a-d71b-48ae-91bb-2f71b7af1afb None admin] PATH_INFO: `/v3/roles/service` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:40.316834 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76853a1a-d71b-48ae-91bb-2f71b7af1afb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:25:40.322597 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-76853a1a-d71b-48ae-91bb-2f71b7af1afb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 15:25:40.322597 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:25:40.322597 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:25:40.322597 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:25:40.322597 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:25:40.322597 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:25:40.322597 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:25:40.322597 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:25:40.322597 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:25:40.322597 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:25:40.322597 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:25:40.322597 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:25:40.322597 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:25:40.322597 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:25:40.322597 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:25:40.322597 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:25:40.324357 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:25:40.324357 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:25:40.324357 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:25:40.324357 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:25:40.324357 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:25:40.324357 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:25:40.324357 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:25:40.324357 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:25:40.324357 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:25:40.324357 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:25:40.324357 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:25:40.324357 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:25:40.324357 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:25:40.324357 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:25:40.324357 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:25:40.324357 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:25:40.325694 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:25:40.325694 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:25:40.325694 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:25:40.325694 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:25:40.325694 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:25:40.325694 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:25:40.325694 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:25:40.325694 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:25:40.325694 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:25:40.325694 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:25:40.325694 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 15:25:40.325694 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:25:40.325694 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 246/486] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jul 26 15:25:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:25:40.325694 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76853a1a-d71b-48ae-91bb-2f71b7af1afb None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:40.342696 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f422aec2-3c91-4aa5-82d1-74f210f40a79 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:40.386914 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5fc6b8-0782-442a-b218-ac7e2e612bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:40.387591 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5fc6b8-0782-442a-b218-ac7e2e612bc8 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:40.387887 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5fc6b8-0782-442a-b218-ac7e2e612bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:40.388276 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5fc6b8-0782-442a-b218-ac7e2e612bc8 None admin] PATH_INFO: `/v3/domains` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:40.389359 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5fc6b8-0782-442a-b218-ac7e2e612bc8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:40.389669 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5fc6b8-0782-442a-b218-ac7e2e612bc8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:40.391472 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5fc6b8-0782-442a-b218-ac7e2e612bc8 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:40.405498 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 241/487] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 15:25:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:40.410880 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5fc6b8-0782-442a-b218-ac7e2e612bc8 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:40.466050 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:40.473012 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76853a1a-d71b-48ae-91bb-2f71b7af1afb None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:40.474680 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:40.518899 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3011ab5b-9c6a-4efb-a56f-267f717a682e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:40.519565 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3011ab5b-9c6a-4efb-a56f-267f717a682e None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:40.519849 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3011ab5b-9c6a-4efb-a56f-267f717a682e None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:40.520128 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3011ab5b-9c6a-4efb-a56f-267f717a682e None admin] PATH_INFO: `/v3/roles` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:40.520857 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3011ab5b-9c6a-4efb-a56f-267f717a682e None admin] RBAC: Adding query filter params (name=service) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:40.521166 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3011ab5b-9c6a-4efb-a56f-267f717a682e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:40.522594 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3011ab5b-9c6a-4efb-a56f-267f717a682e None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:40.531680 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 247/488] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jul 26 15:25:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:40.532545 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3011ab5b-9c6a-4efb-a56f-267f717a682e None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:40.535328 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5fc6b8-0782-442a-b218-ac7e2e612bc8 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:40.572138 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3064ea9f-f128-4df9-a3ac-07530ddc5f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:40.572681 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3064ea9f-f128-4df9-a3ac-07530ddc5f34 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:40.572967 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3064ea9f-f128-4df9-a3ac-07530ddc5f34 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:40.573248 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3064ea9f-f128-4df9-a3ac-07530ddc5f34 None admin] PATH_INFO: `/v3/roles` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:40.573982 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3064ea9f-f128-4df9-a3ac-07530ddc5f34 None admin] RBAC: Adding query filter params (name=service) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:40.574328 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3064ea9f-f128-4df9-a3ac-07530ddc5f34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:40.575773 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3064ea9f-f128-4df9-a3ac-07530ddc5f34 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:40.589948 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 242/489] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jul 26 15:25:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:40.589948 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e7aa42-a13d-45b2-8a7b-46fb7905458d None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:40.589948 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e7aa42-a13d-45b2-8a7b-46fb7905458d None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:40.589948 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e7aa42-a13d-45b2-8a7b-46fb7905458d None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:40.589948 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 243/490] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:25:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:25:40.589948 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e7aa42-a13d-45b2-8a7b-46fb7905458d None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:40.649134 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3011ab5b-9c6a-4efb-a56f-267f717a682e None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:40.690628 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dec9cfc-d0ea-4f79-abfb-831fcd62a246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:40.691659 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec9cfc-d0ea-4f79-abfb-831fcd62a246 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:40.692167 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec9cfc-d0ea-4f79-abfb-831fcd62a246 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:40.692576 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec9cfc-d0ea-4f79-abfb-831fcd62a246 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:40.707278 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dec9cfc-d0ea-4f79-abfb-831fcd62a246 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:40.709928 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dec9cfc-d0ea-4f79-abfb-831fcd62a246 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:40.729468 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e7aa42-a13d-45b2-8a7b-46fb7905458d None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:40.733286 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-0dec9cfc-d0ea-4f79-abfb-831fcd62a246 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 15:25:40.733286 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:25:40.733286 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:25:40.733286 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:25:40.733286 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:25:40.733286 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:25:40.733286 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:25:40.733286 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:25:40.733286 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:25:40.733286 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:25:40.733286 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:25:40.733286 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:25:40.733286 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 15:25:40.733286 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 15:25:40.733286 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 15:25:40.733286 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 15:25:40.734217 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:25:40.734217 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:25:40.734217 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 15:25:40.734217 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:25:40.734217 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 15:25:40.734217 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:25:40.734217 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:25:40.734217 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:25:40.734217 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:25:40.734217 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:25:40.734217 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:25:40.734217 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:25:40.734217 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:25:40.734217 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:25:40.734217 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:25:40.734217 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:25:40.734217 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:25:40.734217 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:25:40.735152 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:25:40.735152 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:25:40.735152 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 15:25:40.735152 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 15:25:40.735152 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 15:25:40.735152 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 15:25:40.735152 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 15:25:40.735152 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 15:25:40.735152 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 15:25:40.735152 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:25:40.737652 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:40.739282 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 248/491] 10.222.0.18 () {56 vars in 1093 bytes} [Tue Jul 26 15:25:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:25:40.740397 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dec9cfc-d0ea-4f79-abfb-831fcd62a246 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:40.767810 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:40.774113 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073dcf66-695a-4161-9b18-c32cfc1ce0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:40.774835 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073dcf66-695a-4161-9b18-c32cfc1ce0e6 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:40.775072 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073dcf66-695a-4161-9b18-c32cfc1ce0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:40.775767 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073dcf66-695a-4161-9b18-c32cfc1ce0e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:40.787308 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073dcf66-695a-4161-9b18-c32cfc1ce0e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:40.788795 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073dcf66-695a-4161-9b18-c32cfc1ce0e6 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:40.804681 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application [None req-073dcf66-695a-4161-9b18-c32cfc1ce0e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:25:40.804681 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:25:40.804681 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:25:40.804681 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:25:40.804681 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:25:40.804681 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:25:40.804681 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:25:40.804681 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:25:40.804681 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:25:40.804681 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:25:40.804681 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:25:40.804681 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:25:40.804681 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:25:40.804681 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:25:40.804681 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:25:40.805606 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:25:40.805606 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:25:40.805606 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:25:40.805606 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:25:40.805606 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:25:40.805606 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:25:40.805606 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:25:40.805606 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:25:40.805606 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application with Lock( Jul 26 15:25:40.805606 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:25:40.805606 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:25:40.805606 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:25:40.805606 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:25:40.805606 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:25:40.805606 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:25:40.805606 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:25:40.805606 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:25:40.806430 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:25:40.806430 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:25:40.806430 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:25:40.806430 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:25:40.806430 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 244/492] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 15:25:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:25:40.807975 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c4839-6366-4323-a74d-0bc63c523b38 None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:40.808279 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c4839-6366-4323-a74d-0bc63c523b38 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:40.808564 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c4839-6366-4323-a74d-0bc63c523b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:40.829011 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-183c4839-6366-4323-a74d-0bc63c523b38 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:25:40.830151 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-183c4839-6366-4323-a74d-0bc63c523b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:25:40.870490 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dec9cfc-d0ea-4f79-abfb-831fcd62a246 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:40.909759 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 245/493] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:25:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:25:40.910372 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b20427-1f5b-4e2d-8a1b-3eb70f139c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:40.910646 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183c4839-6366-4323-a74d-0bc63c523b38 None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:40.911555 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b20427-1f5b-4e2d-8a1b-3eb70f139c94 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:40.911846 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b20427-1f5b-4e2d-8a1b-3eb70f139c94 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:40.912522 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b20427-1f5b-4e2d-8a1b-3eb70f139c94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:40.938948 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b20427-1f5b-4e2d-8a1b-3eb70f139c94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:40.941743 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b20427-1f5b-4e2d-8a1b-3eb70f139c94 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:40.966083 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-b5b20427-1f5b-4e2d-8a1b-3eb70f139c94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:25:40.966083 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:25:40.966083 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:25:40.966083 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:25:40.966083 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:25:40.966083 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:25:40.966083 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:25:40.966083 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:25:40.966083 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:25:40.966083 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:25:40.966083 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:25:40.966083 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:25:40.966083 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:25:40.966083 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:25:40.966083 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:25:40.967022 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:25:40.967022 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:25:40.967022 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:25:40.967022 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:25:40.967022 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:25:40.967022 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:25:40.967022 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:25:40.967022 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:25:40.967022 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:25:40.967022 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:25:40.967022 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:25:40.967022 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:25:40.967022 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:25:40.967022 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:25:40.967022 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:25:40.967022 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:25:40.967022 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:25:40.967910 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:25:40.967910 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:25:40.967910 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:25:40.967910 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:25:40.967910 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 249/494] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 15:25:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:25:40.968711 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b20427-1f5b-4e2d-8a1b-3eb70f139c94 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:41.011881 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:41.024946 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183c4839-6366-4323-a74d-0bc63c523b38 None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:41.062441 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d7dc3c-d521-47d2-906a-0addf71b3fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:41.063071 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d7dc3c-d521-47d2-906a-0addf71b3fdd None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:41.063392 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d7dc3c-d521-47d2-906a-0addf71b3fdd None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:41.063665 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d7dc3c-d521-47d2-906a-0addf71b3fdd None admin] PATH_INFO: `/v3/users` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:41.064466 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d7dc3c-d521-47d2-906a-0addf71b3fdd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:41.064771 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d7dc3c-d521-47d2-906a-0addf71b3fdd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:41.065175 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:41.066233 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d7dc3c-d521-47d2-906a-0addf71b3fdd None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:41.094837 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b20427-1f5b-4e2d-8a1b-3eb70f139c94 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:41.105148 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 246/495] 10.222.0.18 () {56 vars in 1133 bytes} [Tue Jul 26 15:25:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:41.107646 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d7dc3c-d521-47d2-906a-0addf71b3fdd None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:41.136689 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b37baef-abd1-4b11-80c5-25dc5c66e7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:41.137315 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37baef-abd1-4b11-80c5-25dc5c66e7ca None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:41.137617 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37baef-abd1-4b11-80c5-25dc5c66e7ca None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:41.138263 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37baef-abd1-4b11-80c5-25dc5c66e7ca None admin] PATH_INFO: `/v3/domains` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:41.138567 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b37baef-abd1-4b11-80c5-25dc5c66e7ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:41.138870 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b37baef-abd1-4b11-80c5-25dc5c66e7ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:41.140326 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b37baef-abd1-4b11-80c5-25dc5c66e7ca None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:41.153976 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 250/496] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 15:25:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:41.154824 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b37baef-abd1-4b11-80c5-25dc5c66e7ca None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:41.229879 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d7dc3c-d521-47d2-906a-0addf71b3fdd None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:41.261331 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b37baef-abd1-4b11-80c5-25dc5c66e7ca None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:41.283750 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51fe5c7-fba4-4ac8-a6ca-fe755c0469f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:41.284731 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51fe5c7-fba4-4ac8-a6ca-fe755c0469f3 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:41.285157 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51fe5c7-fba4-4ac8-a6ca-fe755c0469f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:41.285668 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51fe5c7-fba4-4ac8-a6ca-fe755c0469f3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:41.298466 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51fe5c7-fba4-4ac8-a6ca-fe755c0469f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:25:41.298684 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ecac9f-69fd-403b-978e-7c50f6aa4895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:41.299294 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ecac9f-69fd-403b-978e-7c50f6aa4895 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:41.299584 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ecac9f-69fd-403b-978e-7c50f6aa4895 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:41.299865 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ecac9f-69fd-403b-978e-7c50f6aa4895 None admin] PATH_INFO: `/v3/domains` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:41.300572 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ecac9f-69fd-403b-978e-7c50f6aa4895 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:41.300879 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ecac9f-69fd-403b-978e-7c50f6aa4895 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:41.302329 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ecac9f-69fd-403b-978e-7c50f6aa4895 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:41.303766 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application [None req-b51fe5c7-fba4-4ac8-a6ca-fe755c0469f3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 15:25:41.303766 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:25:41.303766 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:25:41.303766 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:25:41.303766 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:25:41.303766 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:25:41.303766 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:25:41.303766 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:25:41.303766 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:25:41.303766 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:25:41.303766 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:25:41.303766 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:25:41.303766 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:25:41.303766 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:25:41.303766 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:25:41.303766 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:25:41.304768 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:25:41.304768 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:25:41.304768 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:25:41.304768 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:25:41.304768 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:25:41.304768 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:25:41.304768 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:25:41.304768 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:25:41.304768 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:25:41.304768 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:25:41.304768 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:25:41.304768 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application with Lock( Jul 26 15:25:41.304768 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:25:41.304768 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:25:41.304768 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:25:41.304768 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:25:41.305675 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:25:41.305675 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:25:41.305675 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:25:41.305675 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:25:41.305675 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:25:41.305675 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:25:41.305675 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:25:41.305675 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:25:41.305675 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:25:41.305675 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:25:41.305675 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 15:25:41.305675 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:25:41.305675 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 247/497] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jul 26 15:25:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:25:41.306330 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51fe5c7-fba4-4ac8-a6ca-fe755c0469f3 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:41.307190 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:41.315959 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:41.319248 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 251/498] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 15:25:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:41.320321 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ecac9f-69fd-403b-978e-7c50f6aa4895 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:41.426518 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51fe5c7-fba4-4ac8-a6ca-fe755c0469f3 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:41.435223 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ecac9f-69fd-403b-978e-7c50f6aa4895 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:41.470285 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe152be-38e1-488d-b99d-123d9899b245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:41.470934 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe152be-38e1-488d-b99d-123d9899b245 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:41.471250 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe152be-38e1-488d-b99d-123d9899b245 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:41.471531 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe152be-38e1-488d-b99d-123d9899b245 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:41.476882 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c545900-62d9-4e64-9e5b-ef33e00418a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:41.477544 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c545900-62d9-4e64-9e5b-ef33e00418a3 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:41.477855 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c545900-62d9-4e64-9e5b-ef33e00418a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:41.478110 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c545900-62d9-4e64-9e5b-ef33e00418a3 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:41.487675 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c545900-62d9-4e64-9e5b-ef33e00418a3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:41.489220 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c545900-62d9-4e64-9e5b-ef33e00418a3 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:41.505338 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-3c545900-62d9-4e64-9e5b-ef33e00418a3 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 26 15:25:41.505338 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:25:41.505338 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:25:41.505338 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:25:41.505338 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:25:41.505338 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:25:41.505338 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:25:41.505338 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:25:41.505338 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:25:41.505338 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:25:41.505338 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:25:41.505338 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:25:41.505338 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 15:25:41.505338 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 15:25:41.505338 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 15:25:41.505338 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 15:25:41.506535 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:25:41.506535 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:25:41.506535 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 15:25:41.506535 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:25:41.506535 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 15:25:41.506535 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:25:41.506535 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:25:41.506535 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:25:41.506535 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:25:41.506535 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:25:41.506535 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:25:41.506535 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:25:41.506535 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:25:41.506535 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:25:41.506535 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:25:41.506535 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:25:41.506535 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:25:41.506535 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:25:41.514188 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:25:41.514188 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:25:41.514188 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 15:25:41.514188 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 15:25:41.514188 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 15:25:41.514188 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 15:25:41.514188 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 15:25:41.514188 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 15:25:41.514188 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 26 15:25:41.514188 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:25:41.514188 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 252/499] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 15:25:41 2022] GET /identity/v3/users/glance => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:25:41.514188 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c545900-62d9-4e64-9e5b-ef33e00418a3 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:41.567897 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe152be-38e1-488d-b99d-123d9899b245 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:41.570487 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe152be-38e1-488d-b99d-123d9899b245 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:41.583096 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:41.594456 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:41.647842 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c545900-62d9-4e64-9e5b-ef33e00418a3 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:41.706678 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 248/500] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 15:25:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 15:25:41.708875 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe152be-38e1-488d-b99d-123d9899b245 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:41.711919 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16e2003-1fdd-4d18-8e27-2d6c0d4f966f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:41.712879 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e2003-1fdd-4d18-8e27-2d6c0d4f966f None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:41.713341 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e2003-1fdd-4d18-8e27-2d6c0d4f966f None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:41.713850 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e2003-1fdd-4d18-8e27-2d6c0d4f966f None admin] PATH_INFO: `/v3/roles` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:41.714736 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16e2003-1fdd-4d18-8e27-2d6c0d4f966f None admin] RBAC: Adding query filter params (name=service) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:41.722707 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16e2003-1fdd-4d18-8e27-2d6c0d4f966f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:41.722707 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16e2003-1fdd-4d18-8e27-2d6c0d4f966f None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:41.730146 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 253/501] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jul 26 15:25:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:41.731783 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16e2003-1fdd-4d18-8e27-2d6c0d4f966f None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:41.845576 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe152be-38e1-488d-b99d-123d9899b245 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:41.860169 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:41.861617 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16e2003-1fdd-4d18-8e27-2d6c0d4f966f None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:41.885002 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:41.905293 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df122f6-68ed-4754-8062-4c79050f074e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:41.906116 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df122f6-68ed-4754-8062-4c79050f074e None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:41.906448 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df122f6-68ed-4754-8062-4c79050f074e None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:41.906902 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df122f6-68ed-4754-8062-4c79050f074e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:41.913203 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e51c18-887f-4b3d-a93f-701e27aa2ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:41.914146 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e51c18-887f-4b3d-a93f-701e27aa2ed5 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:41.914413 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e51c18-887f-4b3d-a93f-701e27aa2ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:41.914749 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e51c18-887f-4b3d-a93f-701e27aa2ed5 None admin] PATH_INFO: `/v3/users` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:41.915988 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e51c18-887f-4b3d-a93f-701e27aa2ed5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:41.916521 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e51c18-887f-4b3d-a93f-701e27aa2ed5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:41.917403 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df122f6-68ed-4754-8062-4c79050f074e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:41.918681 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e51c18-887f-4b3d-a93f-701e27aa2ed5 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:41.920409 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df122f6-68ed-4754-8062-4c79050f074e None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:41.937178 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application [None req-8df122f6-68ed-4754-8062-4c79050f074e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 26 15:25:41.937178 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:25:41.937178 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:25:41.937178 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:25:41.937178 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:25:41.937178 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:25:41.937178 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:25:41.937178 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:25:41.937178 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:25:41.937178 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:25:41.937178 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:25:41.937178 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:25:41.937178 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 15:25:41.937178 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 15:25:41.937178 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 15:25:41.937178 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 15:25:41.939234 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:25:41.939234 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:25:41.939234 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 15:25:41.939234 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:25:41.939234 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 15:25:41.939234 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:25:41.939234 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:25:41.939234 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:25:41.939234 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:25:41.939234 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:25:41.939234 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:25:41.939234 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application with Lock( Jul 26 15:25:41.939234 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:25:41.939234 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:25:41.939234 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:25:41.939234 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:25:41.939234 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:25:41.939234 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:25:41.941095 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:25:41.941095 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:25:41.941095 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 15:25:41.941095 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 15:25:41.941095 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 15:25:41.941095 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 15:25:41.941095 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 15:25:41.941095 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 15:25:41.941095 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 26 15:25:41.941095 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:25:41.941095 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 249/502] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jul 26 15:25:41 2022] GET /identity/v3/users/neutron => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:25:41.941095 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df122f6-68ed-4754-8062-4c79050f074e None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:41.973194 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 254/503] 10.222.0.18 () {56 vars in 1137 bytes} [Tue Jul 26 15:25:41 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:41.974603 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e51c18-887f-4b3d-a93f-701e27aa2ed5 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:42.087706 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df122f6-68ed-4754-8062-4c79050f074e None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:42.120165 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e51c18-887f-4b3d-a93f-701e27aa2ed5 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:42.129318 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de45350e-2642-4a28-9792-caf3461e135c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:42.129980 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de45350e-2642-4a28-9792-caf3461e135c None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:42.130263 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de45350e-2642-4a28-9792-caf3461e135c None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:42.130542 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de45350e-2642-4a28-9792-caf3461e135c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:42.143396 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de45350e-2642-4a28-9792-caf3461e135c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:42.144915 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de45350e-2642-4a28-9792-caf3461e135c None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:42.161101 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5184a929-2f1d-4888-8a8e-f29c1fd8b116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:42.161421 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application [None req-de45350e-2642-4a28-9792-caf3461e135c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:25:42.161421 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:25:42.161421 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:25:42.161421 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:25:42.161421 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:25:42.161421 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:25:42.161421 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:25:42.161421 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:25:42.161421 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:25:42.161421 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:25:42.161421 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:25:42.161421 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:25:42.161421 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:25:42.161421 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:25:42.161421 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:25:42.163112 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:25:42.163112 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:25:42.163112 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:25:42.163112 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:25:42.163112 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:25:42.163112 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:25:42.163112 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:25:42.163112 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:25:42.163112 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application with Lock( Jul 26 15:25:42.163112 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:25:42.163112 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:25:42.163112 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:25:42.163112 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:25:42.163112 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:25:42.163112 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:25:42.163112 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:25:42.163112 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:25:42.164850 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:25:42.164850 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:25:42.164850 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:25:42.164850 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:25:42.165300 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184a929-2f1d-4888-8a8e-f29c1fd8b116 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:42.165300 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184a929-2f1d-4888-8a8e-f29c1fd8b116 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:42.165300 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184a929-2f1d-4888-8a8e-f29c1fd8b116 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:42.165645 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 250/504] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 15:25:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:25:42.165645 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de45350e-2642-4a28-9792-caf3461e135c None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:42.180547 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5184a929-2f1d-4888-8a8e-f29c1fd8b116 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:42.182073 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5184a929-2f1d-4888-8a8e-f29c1fd8b116 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:42.194641 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:42.200230 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-5184a929-2f1d-4888-8a8e-f29c1fd8b116 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:25:42.200230 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:25:42.200230 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:25:42.200230 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:25:42.200230 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:25:42.200230 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:25:42.200230 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:25:42.200230 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:25:42.200230 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:25:42.200230 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:25:42.200230 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:25:42.200230 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:25:42.200230 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:25:42.200230 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:25:42.200230 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:25:42.202249 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:25:42.202249 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:25:42.202249 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:25:42.202249 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:25:42.202249 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:25:42.202249 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:25:42.202249 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:25:42.202249 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:25:42.202249 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:25:42.202249 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:25:42.202249 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:25:42.202249 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:25:42.202249 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:25:42.202249 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:25:42.202249 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:25:42.202249 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:25:42.202249 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:25:42.204157 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:25:42.204157 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:25:42.204157 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:25:42.204157 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:25:42.204157 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 255/505] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 15:25:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:25:42.204157 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5184a929-2f1d-4888-8a8e-f29c1fd8b116 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:42.238121 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:42.331706 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de45350e-2642-4a28-9792-caf3461e135c None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:42.334312 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5184a929-2f1d-4888-8a8e-f29c1fd8b116 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:42.371874 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914fbb1d-56d5-4a6d-a72e-0a26615fcefb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:42.372516 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914fbb1d-56d5-4a6d-a72e-0a26615fcefb None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:42.372793 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914fbb1d-56d5-4a6d-a72e-0a26615fcefb None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:42.373067 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914fbb1d-56d5-4a6d-a72e-0a26615fcefb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:42.385997 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb47deda-d406-4bf4-b570-2227a1ccd628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:42.387718 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb47deda-d406-4bf4-b570-2227a1ccd628 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:42.388205 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb47deda-d406-4bf4-b570-2227a1ccd628 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:42.388711 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb47deda-d406-4bf4-b570-2227a1ccd628 None admin] PATH_INFO: `/v3/users` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:42.390242 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb47deda-d406-4bf4-b570-2227a1ccd628 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:42.390800 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb47deda-d406-4bf4-b570-2227a1ccd628 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:42.393493 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb47deda-d406-4bf4-b570-2227a1ccd628 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:42.426451 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 251/506] 10.222.0.18 () {56 vars in 1139 bytes} [Tue Jul 26 15:25:42 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:42.427950 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb47deda-d406-4bf4-b570-2227a1ccd628 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:42.473041 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914fbb1d-56d5-4a6d-a72e-0a26615fcefb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:42.474606 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914fbb1d-56d5-4a6d-a72e-0a26615fcefb None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:42.507695 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:42.528928 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:42.554874 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb47deda-d406-4bf4-b570-2227a1ccd628 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:42.591921 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440f9388-1456-4121-ace7-e889684950da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:42.592554 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f9388-1456-4121-ace7-e889684950da None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:42.592871 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f9388-1456-4121-ace7-e889684950da None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:42.593168 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f9388-1456-4121-ace7-e889684950da None admin] PATH_INFO: `/v3/domains` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:42.593869 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440f9388-1456-4121-ace7-e889684950da None admin] RBAC: Adding query filter params (name=Default) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:42.594180 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440f9388-1456-4121-ace7-e889684950da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:42.595677 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440f9388-1456-4121-ace7-e889684950da None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:42.610740 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 252/507] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 15:25:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:42.611640 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440f9388-1456-4121-ace7-e889684950da None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:42.635350 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 256/508] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 15:25:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 15:25:42.636854 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914fbb1d-56d5-4a6d-a72e-0a26615fcefb None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:42.756770 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440f9388-1456-4121-ace7-e889684950da None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:42.783106 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914fbb1d-56d5-4a6d-a72e-0a26615fcefb None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:42.796853 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56d46bf-1a38-4ddf-80ad-833c44cc8de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:42.797497 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56d46bf-1a38-4ddf-80ad-833c44cc8de7 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:42.797784 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56d46bf-1a38-4ddf-80ad-833c44cc8de7 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:42.798064 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56d46bf-1a38-4ddf-80ad-833c44cc8de7 None admin] PATH_INFO: `/v3/domains` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:42.798769 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56d46bf-1a38-4ddf-80ad-833c44cc8de7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:42.799150 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56d46bf-1a38-4ddf-80ad-833c44cc8de7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:42.800534 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56d46bf-1a38-4ddf-80ad-833c44cc8de7 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:42.803284 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:42.813808 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 253/509] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 15:25:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:42.819401 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56d46bf-1a38-4ddf-80ad-833c44cc8de7 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:42.822350 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:42.830978 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e916122-71e8-4dd8-babf-afc2fe8f0768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:42.831650 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e916122-71e8-4dd8-babf-afc2fe8f0768 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:42.831929 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e916122-71e8-4dd8-babf-afc2fe8f0768 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:42.832201 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e916122-71e8-4dd8-babf-afc2fe8f0768 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:42.921550 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e916122-71e8-4dd8-babf-afc2fe8f0768 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:42.923181 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e916122-71e8-4dd8-babf-afc2fe8f0768 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:42.941899 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56d46bf-1a38-4ddf-80ad-833c44cc8de7 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:42.983655 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7de793f-7d36-4c2c-bfe6-764aecd619d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:42.984569 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7de793f-7d36-4c2c-bfe6-764aecd619d9 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:42.985049 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7de793f-7d36-4c2c-bfe6-764aecd619d9 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:42.985326 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7de793f-7d36-4c2c-bfe6-764aecd619d9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:42.993026 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7de793f-7d36-4c2c-bfe6-764aecd619d9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:42.994505 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7de793f-7d36-4c2c-bfe6-764aecd619d9 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:43.009327 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application [None req-b7de793f-7d36-4c2c-bfe6-764aecd619d9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:25:43.009327 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:25:43.009327 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:25:43.009327 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:25:43.009327 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:25:43.009327 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:25:43.009327 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:25:43.009327 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:25:43.009327 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:25:43.009327 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:25:43.009327 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:25:43.009327 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:25:43.009327 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 15:25:43.009327 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 15:25:43.009327 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 15:25:43.015754 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 15:25:43.015754 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:25:43.015754 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:25:43.015754 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:25:43.015754 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:25:43.015754 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:25:43.015754 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:25:43.015754 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:25:43.015754 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application with Lock( Jul 26 15:25:43.015754 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:25:43.015754 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:25:43.015754 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:25:43.015754 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:25:43.015754 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:25:43.015754 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:25:43.015754 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:25:43.015754 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:25:43.017380 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 15:25:43.017380 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 15:25:43.017380 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 15:25:43.017380 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 15:25:43.017380 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 15:25:43.017380 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 15:25:43.017380 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:25:43.017380 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:25:43.017380 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 254/510] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 15:25:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:25:43.017380 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7de793f-7d36-4c2c-bfe6-764aecd619d9 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:43.077898 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:43.096352 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 257/511] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 15:25:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 15:25:43.098243 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e916122-71e8-4dd8-babf-afc2fe8f0768 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:43.132242 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:43.151677 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7de793f-7d36-4c2c-bfe6-764aecd619d9 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:43.216146 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe56035b-bb13-42f0-b0d7-c3116991a5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:43.217281 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56035b-bb13-42f0-b0d7-c3116991a5cd None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:43.217786 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56035b-bb13-42f0-b0d7-c3116991a5cd None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:43.218257 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56035b-bb13-42f0-b0d7-c3116991a5cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:43.219790 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e916122-71e8-4dd8-babf-afc2fe8f0768 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:43.239220 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe56035b-bb13-42f0-b0d7-c3116991a5cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:43.241993 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe56035b-bb13-42f0-b0d7-c3116991a5cd None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:43.269752 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application [None req-fe56035b-bb13-42f0-b0d7-c3116991a5cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:25:43.269752 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:25:43.269752 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:25:43.269752 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:25:43.269752 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:25:43.269752 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:25:43.269752 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:25:43.269752 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:25:43.269752 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:25:43.269752 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:25:43.269752 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:25:43.269752 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:25:43.269752 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:25:43.269752 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:25:43.269752 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:25:43.270701 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:25:43.270701 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:25:43.270701 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:25:43.270701 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:25:43.270701 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:25:43.270701 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:25:43.270701 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:25:43.270701 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:25:43.270701 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application with Lock( Jul 26 15:25:43.270701 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:25:43.270701 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:25:43.270701 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:25:43.270701 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:25:43.270701 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:25:43.270701 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:25:43.270701 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:25:43.270701 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:25:43.271609 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:25:43.271609 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:25:43.271609 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:25:43.271609 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:25:43.271814 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793c061e-d8e0-4d63-8b7d-f6c360cbf98f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:43.271814 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793c061e-d8e0-4d63-8b7d-f6c360cbf98f None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:43.271814 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793c061e-d8e0-4d63-8b7d-f6c360cbf98f None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:43.271814 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793c061e-d8e0-4d63-8b7d-f6c360cbf98f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:43.272126 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 255/512] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 15:25:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:25:43.273487 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe56035b-bb13-42f0-b0d7-c3116991a5cd None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:43.288254 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793c061e-d8e0-4d63-8b7d-f6c360cbf98f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:43.290099 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793c061e-d8e0-4d63-8b7d-f6c360cbf98f None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:43.305089 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-793c061e-d8e0-4d63-8b7d-f6c360cbf98f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 15:25:43.305089 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:25:43.305089 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:25:43.305089 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:25:43.305089 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:25:43.305089 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:25:43.305089 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:25:43.305089 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:25:43.305089 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:25:43.305089 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:25:43.305089 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:25:43.305089 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:25:43.305089 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 15:25:43.305089 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 15:25:43.305089 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 15:25:43.305089 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 15:25:43.307170 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:25:43.307170 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:25:43.307170 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 15:25:43.307170 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:25:43.307170 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 15:25:43.307170 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:25:43.307170 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:25:43.307170 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:25:43.307170 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:25:43.307170 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:25:43.307170 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:25:43.307170 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:25:43.307170 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:25:43.307170 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:25:43.307170 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:25:43.307170 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:25:43.307170 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:25:43.307170 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:25:43.309690 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:25:43.309690 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:25:43.309690 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 15:25:43.309690 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 15:25:43.309690 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 15:25:43.309690 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 15:25:43.309690 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 15:25:43.309690 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 15:25:43.309690 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 15:25:43.309690 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:25:43.309690 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 258/513] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 15:25:43 2022] GET /identity/v3/users/cinder => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:25:43.309690 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793c061e-d8e0-4d63-8b7d-f6c360cbf98f None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:43.426551 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:43.429211 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe56035b-bb13-42f0-b0d7-c3116991a5cd None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:43.441654 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:43.442106 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793c061e-d8e0-4d63-8b7d-f6c360cbf98f None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:43.475773 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5ad9f9-2967-4eee-bbd8-f25d9b4c760d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:43.476832 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ad9f9-2967-4eee-bbd8-f25d9b4c760d None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:43.477317 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ad9f9-2967-4eee-bbd8-f25d9b4c760d None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:43.477804 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ad9f9-2967-4eee-bbd8-f25d9b4c760d None admin] PATH_INFO: `/v3/projects` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:43.479322 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5ad9f9-2967-4eee-bbd8-f25d9b4c760d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:43.479766 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5ad9f9-2967-4eee-bbd8-f25d9b4c760d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:43.482729 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5ad9f9-2967-4eee-bbd8-f25d9b4c760d None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:43.484488 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5355022f-41ad-4049-a1b6-ee266a9ac1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:43.485257 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355022f-41ad-4049-a1b6-ee266a9ac1d8 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:43.485541 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355022f-41ad-4049-a1b6-ee266a9ac1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:43.485818 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355022f-41ad-4049-a1b6-ee266a9ac1d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:43.498870 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5355022f-41ad-4049-a1b6-ee266a9ac1d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:43.500432 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5355022f-41ad-4049-a1b6-ee266a9ac1d8 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:43.516592 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-5355022f-41ad-4049-a1b6-ee266a9ac1d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:25:43.516592 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:25:43.516592 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:25:43.516592 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:25:43.516592 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:25:43.516592 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:25:43.516592 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:25:43.516592 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:25:43.516592 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:25:43.516592 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:25:43.516592 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:25:43.516592 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:25:43.516592 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:25:43.516592 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:25:43.516592 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:25:43.518227 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:25:43.518227 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:25:43.518227 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:25:43.518227 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:25:43.518227 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:25:43.518227 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:25:43.518227 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:25:43.518227 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:25:43.518227 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:25:43.518227 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:25:43.518227 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:25:43.518227 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:25:43.518227 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:25:43.518227 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:25:43.518227 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:25:43.518227 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:25:43.518227 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:25:43.520111 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:25:43.520111 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:25:43.520111 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:25:43.520111 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:25:43.520111 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 259/514] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 15:25:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:25:43.520111 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5355022f-41ad-4049-a1b6-ee266a9ac1d8 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:43.520969 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 256/515] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jul 26 15:25:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:43.520969 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5ad9f9-2967-4eee-bbd8-f25d9b4c760d None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:43.648869 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5ad9f9-2967-4eee-bbd8-f25d9b4c760d None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:43.697482 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7040d4a6-4f65-4fb2-8f01-a4e9376f5483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:43.698210 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7040d4a6-4f65-4fb2-8f01-a4e9376f5483 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:43.698574 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7040d4a6-4f65-4fb2-8f01-a4e9376f5483 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:43.698937 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7040d4a6-4f65-4fb2-8f01-a4e9376f5483 None admin] PATH_INFO: `/v3/users` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:43.700472 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7040d4a6-4f65-4fb2-8f01-a4e9376f5483 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:43.700870 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7040d4a6-4f65-4fb2-8f01-a4e9376f5483 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:43.702536 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7040d4a6-4f65-4fb2-8f01-a4e9376f5483 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:43.722544 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 257/516] 10.222.0.18 () {56 vars in 1137 bytes} [Tue Jul 26 15:25:43 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:43.723499 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7040d4a6-4f65-4fb2-8f01-a4e9376f5483 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:43.753926 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:43.781566 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5355022f-41ad-4049-a1b6-ee266a9ac1d8 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:43.820900 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc040153-12a0-44c9-9e97-73e6580ec4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:43.821877 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc040153-12a0-44c9-9e97-73e6580ec4b3 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:43.822340 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc040153-12a0-44c9-9e97-73e6580ec4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:43.822803 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc040153-12a0-44c9-9e97-73e6580ec4b3 None admin] PATH_INFO: `/v3/domains` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:43.824039 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc040153-12a0-44c9-9e97-73e6580ec4b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:43.824954 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc040153-12a0-44c9-9e97-73e6580ec4b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:43.827410 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc040153-12a0-44c9-9e97-73e6580ec4b3 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:43.842828 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:43.847747 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 260/517] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 15:25:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:43.848069 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7040d4a6-4f65-4fb2-8f01-a4e9376f5483 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:43.850954 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc040153-12a0-44c9-9e97-73e6580ec4b3 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:43.898958 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1304c8-6aee-4274-a360-044a68a95fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:43.899735 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1304c8-6aee-4274-a360-044a68a95fe6 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:43.901333 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1304c8-6aee-4274-a360-044a68a95fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:43.901333 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1304c8-6aee-4274-a360-044a68a95fe6 None admin] PATH_INFO: `/v3/domains` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:43.901333 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1304c8-6aee-4274-a360-044a68a95fe6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:43.901333 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1304c8-6aee-4274-a360-044a68a95fe6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:43.903335 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1304c8-6aee-4274-a360-044a68a95fe6 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:43.923369 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 258/518] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 15:25:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:43.924270 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1304c8-6aee-4274-a360-044a68a95fe6 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:43.987802 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc040153-12a0-44c9-9e97-73e6580ec4b3 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:44.038857 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d114e7-b1bf-44b2-85a9-9d77bfbb21a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:44.039548 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d114e7-b1bf-44b2-85a9-9d77bfbb21a3 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:44.039842 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d114e7-b1bf-44b2-85a9-9d77bfbb21a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:44.040116 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d114e7-b1bf-44b2-85a9-9d77bfbb21a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:44.040934 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d114e7-b1bf-44b2-85a9-9d77bfbb21a3 None admin] RBAC: Adding query filter params (role.id=2a6f012a2a004fbb8ab4d8a5f8633a22, scope.project.id=9178e468facc41d6a7d828dfcd5301b4, user.id=fbc5f2b36d3f45f1b3c8155e46c46fda) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:44.041255 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d114e7-b1bf-44b2-85a9-9d77bfbb21a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:44.042777 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d114e7-b1bf-44b2-85a9-9d77bfbb21a3 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:44.051083 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 261/519] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 26 15:25:43 2022] GET /identity/v3/role_assignments?user.id=fbc5f2b36d3f45f1b3c8155e46c46fda&scope.project.id=9178e468facc41d6a7d828dfcd5301b4&role.id=2a6f012a2a004fbb8ab4d8a5f8633a22 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:44.052995 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d114e7-b1bf-44b2-85a9-9d77bfbb21a3 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:44.074345 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:44.097774 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1304c8-6aee-4274-a360-044a68a95fe6 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:44.139667 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de66b5ba-eaf3-4fc2-9f1c-487bc0b0f852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:44.140378 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de66b5ba-eaf3-4fc2-9f1c-487bc0b0f852 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:44.140672 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de66b5ba-eaf3-4fc2-9f1c-487bc0b0f852 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:44.140956 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de66b5ba-eaf3-4fc2-9f1c-487bc0b0f852 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:44.181074 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:44.254722 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d114e7-b1bf-44b2-85a9-9d77bfbb21a3 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:44.278877 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de66b5ba-eaf3-4fc2-9f1c-487bc0b0f852 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:44.281052 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de66b5ba-eaf3-4fc2-9f1c-487bc0b0f852 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:44.324695 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1907ba3d-b79e-4d85-9cfb-03d9f6346003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:44.325838 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1907ba3d-b79e-4d85-9cfb-03d9f6346003 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:44.326360 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1907ba3d-b79e-4d85-9cfb-03d9f6346003 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:44.326869 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1907ba3d-b79e-4d85-9cfb-03d9f6346003 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:44.339579 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1907ba3d-b79e-4d85-9cfb-03d9f6346003 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:44.342997 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1907ba3d-b79e-4d85-9cfb-03d9f6346003 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:44.366561 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-1907ba3d-b79e-4d85-9cfb-03d9f6346003 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:25:44.366561 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:25:44.366561 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:25:44.366561 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:25:44.366561 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:25:44.366561 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:25:44.366561 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:25:44.366561 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:25:44.366561 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:25:44.366561 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:25:44.366561 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:25:44.366561 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:25:44.366561 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 15:25:44.366561 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 15:25:44.366561 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 15:25:44.368236 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 15:25:44.368236 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:25:44.368236 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:25:44.368236 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:25:44.368236 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:25:44.368236 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:25:44.368236 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:25:44.368236 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:25:44.368236 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:25:44.368236 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:25:44.368236 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:25:44.368236 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:25:44.368236 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:25:44.368236 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:25:44.368236 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:25:44.368236 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:25:44.368236 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:25:44.369453 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 15:25:44.369453 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 15:25:44.369453 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 15:25:44.369453 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 15:25:44.369453 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 15:25:44.369453 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 15:25:44.369453 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:25:44.369453 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:25:44.369453 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 262/520] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 15:25:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:25:44.370756 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1907ba3d-b79e-4d85-9cfb-03d9f6346003 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:44.407441 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:44.440844 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 259/521] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 15:25:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 15:25:44.443798 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de66b5ba-eaf3-4fc2-9f1c-487bc0b0f852 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:44.548072 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1907ba3d-b79e-4d85-9cfb-03d9f6346003 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:44.590443 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de66b5ba-eaf3-4fc2-9f1c-487bc0b0f852 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:44.595765 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:44.612945 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb61114-d84a-4a4c-8a35-2bd726c6737b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:44.614456 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb61114-d84a-4a4c-8a35-2bd726c6737b None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:44.615020 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb61114-d84a-4a4c-8a35-2bd726c6737b None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:44.615461 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb61114-d84a-4a4c-8a35-2bd726c6737b None admin] PATH_INFO: `/v3/projects/service` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:44.624512 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb61114-d84a-4a4c-8a35-2bd726c6737b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:44.626303 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb61114-d84a-4a4c-8a35-2bd726c6737b None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:44.642505 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-6bb61114-d84a-4a4c-8a35-2bd726c6737b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:25:44.642505 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:25:44.642505 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:25:44.642505 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:25:44.642505 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:25:44.642505 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:25:44.642505 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:25:44.642505 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:25:44.642505 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:25:44.642505 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:25:44.642505 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:25:44.642505 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:25:44.642505 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 15:25:44.642505 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 15:25:44.642505 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 15:25:44.652066 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 15:25:44.652066 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:25:44.652066 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:25:44.652066 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:25:44.652066 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:25:44.652066 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:25:44.652066 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:25:44.652066 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:25:44.652066 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:25:44.652066 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:25:44.652066 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:25:44.652066 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:25:44.652066 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:25:44.652066 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:25:44.652066 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:25:44.652066 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:25:44.652066 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:25:44.654202 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 15:25:44.654202 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 15:25:44.654202 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 15:25:44.654202 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 15:25:44.654202 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 15:25:44.654202 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 15:25:44.654202 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:25:44.654202 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:25:44.654202 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 263/522] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 15:25:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:25:44.654202 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb61114-d84a-4a4c-8a35-2bd726c6737b None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:44.662691 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a5fe24-1bc4-473c-a251-fabcd69e23a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:44.663878 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a5fe24-1bc4-473c-a251-fabcd69e23a0 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:44.669572 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a5fe24-1bc4-473c-a251-fabcd69e23a0 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:44.669572 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a5fe24-1bc4-473c-a251-fabcd69e23a0 None admin] PATH_INFO: `/v3/projects` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:44.669572 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a5fe24-1bc4-473c-a251-fabcd69e23a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:44.669572 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a5fe24-1bc4-473c-a251-fabcd69e23a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:44.670087 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a5fe24-1bc4-473c-a251-fabcd69e23a0 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:44.692655 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 260/523] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jul 26 15:25:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:44.694152 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a5fe24-1bc4-473c-a251-fabcd69e23a0 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:44.776876 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:44.831757 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb61114-d84a-4a4c-8a35-2bd726c6737b None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:44.870537 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a5fe24-1bc4-473c-a251-fabcd69e23a0 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:44.881607 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a0855b-3440-4e96-9969-72b3603e0fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:44.882570 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0855b-3440-4e96-9969-72b3603e0fae None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:44.883016 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0855b-3440-4e96-9969-72b3603e0fae None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:44.883449 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0855b-3440-4e96-9969-72b3603e0fae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:44.901683 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a0855b-3440-4e96-9969-72b3603e0fae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:44.905880 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a0855b-3440-4e96-9969-72b3603e0fae None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:44.939788 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f561528-cbcd-4ae5-b7a7-d5d35fa794e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:44.940920 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f561528-cbcd-4ae5-b7a7-d5d35fa794e3 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:44.941472 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f561528-cbcd-4ae5-b7a7-d5d35fa794e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:44.941762 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-03a0855b-3440-4e96-9969-72b3603e0fae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:25:44.941762 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:25:44.941762 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:25:44.941762 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:25:44.941762 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:25:44.941762 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:25:44.941762 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:25:44.941762 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:25:44.941762 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:25:44.941762 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:25:44.941762 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:25:44.941762 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:25:44.941762 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:25:44.941762 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:25:44.941762 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:25:44.942863 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:25:44.942863 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:25:44.942863 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:25:44.942863 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:25:44.942863 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:25:44.942863 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:25:44.942863 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:25:44.942863 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:25:44.942863 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:25:44.942863 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:25:44.942863 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:25:44.942863 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:25:44.942863 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:25:44.942863 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:25:44.942863 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:25:44.942863 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:25:44.942863 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:25:44.944906 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:25:44.944906 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:25:44.944906 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:25:44.944906 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:25:44.945169 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f561528-cbcd-4ae5-b7a7-d5d35fa794e3 None admin] PATH_INFO: `/v3/projects` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:44.946163 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f561528-cbcd-4ae5-b7a7-d5d35fa794e3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:44.946829 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f561528-cbcd-4ae5-b7a7-d5d35fa794e3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:44.949710 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f561528-cbcd-4ae5-b7a7-d5d35fa794e3 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:44.951924 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 264/524] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 15:25:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:25:44.953349 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a0855b-3440-4e96-9969-72b3603e0fae None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:44.967406 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 261/525] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jul 26 15:25:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:44.968513 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f561528-cbcd-4ae5-b7a7-d5d35fa794e3 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:45.033687 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:45.131298 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a0855b-3440-4e96-9969-72b3603e0fae None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:45.144227 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f561528-cbcd-4ae5-b7a7-d5d35fa794e3 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:45.158852 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:45.189975 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5672f956-cc2d-4c29-942f-79f4aa40b68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:45.191067 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5672f956-cc2d-4c29-942f-79f4aa40b68d None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:45.191625 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5672f956-cc2d-4c29-942f-79f4aa40b68d None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:45.192137 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5672f956-cc2d-4c29-942f-79f4aa40b68d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:45.193865 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5672f956-cc2d-4c29-942f-79f4aa40b68d None admin] RBAC: Adding query filter params (role.id=2a6f012a2a004fbb8ab4d8a5f8633a22, scope.project.id=9178e468facc41d6a7d828dfcd5301b4, user.id=d903ca1082154ef2bfac7156d22ddac6) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:45.194443 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5672f956-cc2d-4c29-942f-79f4aa40b68d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:45.197280 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5672f956-cc2d-4c29-942f-79f4aa40b68d None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:45.217514 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa75dfb8-ec3b-45ca-b09c-5490a0dbefc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:45.217738 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 265/526] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 26 15:25:44 2022] GET /identity/v3/role_assignments?user.id=d903ca1082154ef2bfac7156d22ddac6&scope.project.id=9178e468facc41d6a7d828dfcd5301b4&role.id=2a6f012a2a004fbb8ab4d8a5f8633a22 => generated 259 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:45.217855 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa75dfb8-ec3b-45ca-b09c-5490a0dbefc3 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:45.217855 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa75dfb8-ec3b-45ca-b09c-5490a0dbefc3 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:45.218017 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5672f956-cc2d-4c29-942f-79f4aa40b68d None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:45.218098 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa75dfb8-ec3b-45ca-b09c-5490a0dbefc3 None admin] PATH_INFO: `/v3/domains` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:45.218098 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa75dfb8-ec3b-45ca-b09c-5490a0dbefc3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:45.218098 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa75dfb8-ec3b-45ca-b09c-5490a0dbefc3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:45.218098 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa75dfb8-ec3b-45ca-b09c-5490a0dbefc3 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:45.241924 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 262/527] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 15:25:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:45.252907 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa75dfb8-ec3b-45ca-b09c-5490a0dbefc3 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:45.383651 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:45.388615 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5672f956-cc2d-4c29-942f-79f4aa40b68d None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:45.435925 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95aafd6-4a59-4996-9a45-faddd4fec525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:45.436866 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95aafd6-4a59-4996-9a45-faddd4fec525 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:45.437392 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95aafd6-4a59-4996-9a45-faddd4fec525 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:45.437821 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95aafd6-4a59-4996-9a45-faddd4fec525 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:45.438798 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95aafd6-4a59-4996-9a45-faddd4fec525 None admin] RBAC: Adding query filter params (role.id=2a6f012a2a004fbb8ab4d8a5f8633a22, scope.project.id=9178e468facc41d6a7d828dfcd5301b4, user.id=960c230d1e8841e6b231fdbf4d172cc6) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:45.439318 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95aafd6-4a59-4996-9a45-faddd4fec525 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:45.441015 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95aafd6-4a59-4996-9a45-faddd4fec525 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:45.455771 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 266/528] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 26 15:25:45 2022] GET /identity/v3/role_assignments?user.id=960c230d1e8841e6b231fdbf4d172cc6&scope.project.id=9178e468facc41d6a7d828dfcd5301b4&role.id=2a6f012a2a004fbb8ab4d8a5f8633a22 => generated 259 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:45.509061 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa75dfb8-ec3b-45ca-b09c-5490a0dbefc3 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:45.597897 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd1a1d-0ac8-4464-a1b7-4dd5539117a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:45.599080 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd1a1d-0ac8-4464-a1b7-4dd5539117a7 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:45.599643 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd1a1d-0ac8-4464-a1b7-4dd5539117a7 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:45.600226 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd1a1d-0ac8-4464-a1b7-4dd5539117a7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:45.615464 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fd1a1d-0ac8-4464-a1b7-4dd5539117a7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:45.618567 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fd1a1d-0ac8-4464-a1b7-4dd5539117a7 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:45.644041 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application [None req-19fd1a1d-0ac8-4464-a1b7-4dd5539117a7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:25:45.644041 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:25:45.644041 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:25:45.644041 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:25:45.644041 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:25:45.644041 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:25:45.644041 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:25:45.644041 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:25:45.644041 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:25:45.644041 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:25:45.644041 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:25:45.644041 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:25:45.644041 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 15:25:45.644041 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 15:25:45.644041 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 15:25:45.645035 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 15:25:45.645035 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:25:45.645035 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:25:45.645035 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:25:45.645035 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:25:45.645035 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:25:45.645035 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:25:45.645035 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:25:45.645035 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application with Lock( Jul 26 15:25:45.645035 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:25:45.645035 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:25:45.645035 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:25:45.645035 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:25:45.645035 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:25:45.645035 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:25:45.645035 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:25:45.645035 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:25:45.645979 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 15:25:45.645979 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 15:25:45.645979 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 15:25:45.645979 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 15:25:45.645979 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 15:25:45.645979 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 15:25:45.645979 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:25:45.645979 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:25:45.646841 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 263/529] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 15:25:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 396 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:25:45.656783 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95aafd6-4a59-4996-9a45-faddd4fec525 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:45.817468 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95aafd6-4a59-4996-9a45-faddd4fec525 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:45.857929 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f80aca2-f218-49d6-9d1b-b3c3b6d15d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:45.858867 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f80aca2-f218-49d6-9d1b-b3c3b6d15d66 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:45.859338 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f80aca2-f218-49d6-9d1b-b3c3b6d15d66 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:45.859794 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f80aca2-f218-49d6-9d1b-b3c3b6d15d66 None admin] PATH_INFO: `/v3/projects` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:45.860719 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f80aca2-f218-49d6-9d1b-b3c3b6d15d66 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:45.861181 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f80aca2-f218-49d6-9d1b-b3c3b6d15d66 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:45.862813 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f80aca2-f218-49d6-9d1b-b3c3b6d15d66 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:45.883255 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 267/530] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jul 26 15:25:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:45.891306 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd1a1d-0ac8-4464-a1b7-4dd5539117a7 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:45.960138 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:46.109940 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd1a1d-0ac8-4464-a1b7-4dd5539117a7 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:46.176507 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9607cabc-aaab-4d8a-a57c-c202408a9acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:46.177561 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9607cabc-aaab-4d8a-a57c-c202408a9acf None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:46.178062 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9607cabc-aaab-4d8a-a57c-c202408a9acf None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:46.178559 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9607cabc-aaab-4d8a-a57c-c202408a9acf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:46.180049 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9607cabc-aaab-4d8a-a57c-c202408a9acf None admin] RBAC: Adding query filter params (role.id=2a6f012a2a004fbb8ab4d8a5f8633a22, scope.project.id=9178e468facc41d6a7d828dfcd5301b4, user.id=279031fbf2114c11883018b0d41e243a) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:46.180615 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9607cabc-aaab-4d8a-a57c-c202408a9acf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:46.184112 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9607cabc-aaab-4d8a-a57c-c202408a9acf None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:46.195474 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 264/531] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 26 15:25:45 2022] GET /identity/v3/role_assignments?user.id=279031fbf2114c11883018b0d41e243a&scope.project.id=9178e468facc41d6a7d828dfcd5301b4&role.id=2a6f012a2a004fbb8ab4d8a5f8633a22 => generated 259 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:46.565543 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f5836-1f14-41dd-bdc9-e0f99efce673 None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:46.565925 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f5836-1f14-41dd-bdc9-e0f99efce673 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:46.566355 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f5836-1f14-41dd-bdc9-e0f99efce673 None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:46.568497 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 268/532] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:25:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:25:46.576110 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ce666-c947-4cf6-9b04-55f2e6886d4c None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:46.576616 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ce666-c947-4cf6-9b04-55f2e6886d4c None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:46.576690 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ce666-c947-4cf6-9b04-55f2e6886d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:46.604943 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-209ce666-c947-4cf6-9b04-55f2e6886d4c None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:25:46.607860 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-209ce666-c947-4cf6-9b04-55f2e6886d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:25:46.723637 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 265/533] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:25:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:25:46.770144 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10f5836-1f14-41dd-bdc9-e0f99efce673 None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:46.805020 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:46.892623 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10f5836-1f14-41dd-bdc9-e0f99efce673 None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:46.932722 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27137941-efd1-4037-8285-6f6859fd6404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:46.933796 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27137941-efd1-4037-8285-6f6859fd6404 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:46.934278 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27137941-efd1-4037-8285-6f6859fd6404 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:46.934738 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27137941-efd1-4037-8285-6f6859fd6404 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:46.948050 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27137941-efd1-4037-8285-6f6859fd6404 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:25:46.953549 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-27137941-efd1-4037-8285-6f6859fd6404 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 15:25:46.953549 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:25:46.953549 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:25:46.953549 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:25:46.953549 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:25:46.953549 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:25:46.953549 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:25:46.953549 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:25:46.953549 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:25:46.953549 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:25:46.953549 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:25:46.953549 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:25:46.953549 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:25:46.953549 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:25:46.953549 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:25:46.953549 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:25:46.955854 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:25:46.955854 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:25:46.955854 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:25:46.955854 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:25:46.955854 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:25:46.955854 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:25:46.955854 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:25:46.955854 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:25:46.955854 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:25:46.955854 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:25:46.955854 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:25:46.955854 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:25:46.955854 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:25:46.955854 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:25:46.955854 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:25:46.955854 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:25:46.957479 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:25:46.957479 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:25:46.957479 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:25:46.957479 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:25:46.957479 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:25:46.957479 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:25:46.957479 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:25:46.957479 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:25:46.957479 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:25:46.957479 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:25:46.957479 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 15:25:46.957479 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:25:46.957479 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 269/534] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jul 26 15:25:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:25:46.970558 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209ce666-c947-4cf6-9b04-55f2e6886d4c None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:47.011532 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:47.109635 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209ce666-c947-4cf6-9b04-55f2e6886d4c None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:47.148115 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aab6954-a7a1-4842-aacd-9bdd94e06c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:47.149123 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab6954-a7a1-4842-aacd-9bdd94e06c2b None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:47.149625 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab6954-a7a1-4842-aacd-9bdd94e06c2b None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:47.150109 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab6954-a7a1-4842-aacd-9bdd94e06c2b None admin] PATH_INFO: `/v3/roles` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:47.151044 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aab6954-a7a1-4842-aacd-9bdd94e06c2b None admin] RBAC: Adding query filter params (name=service) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:47.151608 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aab6954-a7a1-4842-aacd-9bdd94e06c2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:47.153781 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aab6954-a7a1-4842-aacd-9bdd94e06c2b None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:47.163689 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 266/535] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jul 26 15:25:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:47.171459 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27137941-efd1-4037-8285-6f6859fd6404 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:47.268245 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:47.287267 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27137941-efd1-4037-8285-6f6859fd6404 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:47.336682 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff80d72-f39f-40d5-9289-eaaed024c7f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:47.337704 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff80d72-f39f-40d5-9289-eaaed024c7f7 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:47.338028 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff80d72-f39f-40d5-9289-eaaed024c7f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:47.338306 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff80d72-f39f-40d5-9289-eaaed024c7f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:47.352230 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff80d72-f39f-40d5-9289-eaaed024c7f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:47.353739 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff80d72-f39f-40d5-9289-eaaed024c7f7 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:47.369841 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-8ff80d72-f39f-40d5-9289-eaaed024c7f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:25:47.369841 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:25:47.369841 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:25:47.369841 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:25:47.369841 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:25:47.369841 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:25:47.369841 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:25:47.369841 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:25:47.369841 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:25:47.369841 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:25:47.369841 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:25:47.369841 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:25:47.369841 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:25:47.369841 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:25:47.369841 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:25:47.370915 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:25:47.370915 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:25:47.370915 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:25:47.370915 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:25:47.370915 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:25:47.370915 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:25:47.370915 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:25:47.370915 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:25:47.370915 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:25:47.370915 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:25:47.370915 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:25:47.370915 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:25:47.370915 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:25:47.370915 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:25:47.370915 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:25:47.370915 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:25:47.370915 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:25:47.371784 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:25:47.371784 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:25:47.371784 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:25:47.371784 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:25:47.371784 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 270/536] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 15:25:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:25:47.376998 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aab6954-a7a1-4842-aacd-9bdd94e06c2b None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:47.467735 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:47.488021 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aab6954-a7a1-4842-aacd-9bdd94e06c2b None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:47.526180 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29336b91-1e38-4d39-aa67-3c2126bdd209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:47.527851 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29336b91-1e38-4d39-aa67-3c2126bdd209 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:47.528342 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29336b91-1e38-4d39-aa67-3c2126bdd209 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:47.528835 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29336b91-1e38-4d39-aa67-3c2126bdd209 None admin] PATH_INFO: `/v3/domains` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:47.529744 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29336b91-1e38-4d39-aa67-3c2126bdd209 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:47.530257 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29336b91-1e38-4d39-aa67-3c2126bdd209 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:47.531888 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29336b91-1e38-4d39-aa67-3c2126bdd209 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:47.546986 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 267/537] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 15:25:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:47.553088 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff80d72-f39f-40d5-9289-eaaed024c7f7 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:47.665959 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff80d72-f39f-40d5-9289-eaaed024c7f7 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:47.703491 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4b2daf-45f6-453f-9ba6-e655a5887ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:47.704153 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b2daf-45f6-453f-9ba6-e655a5887ac9 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:47.704443 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b2daf-45f6-453f-9ba6-e655a5887ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:47.704723 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b2daf-45f6-453f-9ba6-e655a5887ac9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:47.707876 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:47.713466 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4b2daf-45f6-453f-9ba6-e655a5887ac9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:47.715615 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4b2daf-45f6-453f-9ba6-e655a5887ac9 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:47.728081 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-bf4b2daf-45f6-453f-9ba6-e655a5887ac9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 15:25:47.728081 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:25:47.728081 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:25:47.728081 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:25:47.728081 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:25:47.728081 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:25:47.728081 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:25:47.728081 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:25:47.728081 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:25:47.728081 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:25:47.728081 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:25:47.728081 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:25:47.728081 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 15:25:47.728081 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 15:25:47.728081 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 15:25:47.728081 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 15:25:47.729023 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:25:47.729023 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:25:47.729023 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 15:25:47.729023 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:25:47.729023 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 15:25:47.729023 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:25:47.729023 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:25:47.729023 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:25:47.729023 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:25:47.729023 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:25:47.729023 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:25:47.729023 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:25:47.729023 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:25:47.729023 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:25:47.729023 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:25:47.729023 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:25:47.729023 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:25:47.729023 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:25:47.730315 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:25:47.730315 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:25:47.730315 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 15:25:47.730315 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 15:25:47.730315 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 15:25:47.730315 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 15:25:47.730315 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 15:25:47.730315 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 15:25:47.730315 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 15:25:47.730315 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:25:47.730315 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 271/538] 10.222.0.18 () {56 vars in 1093 bytes} [Tue Jul 26 15:25:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:25:47.737878 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29336b91-1e38-4d39-aa67-3c2126bdd209 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:47.853024 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29336b91-1e38-4d39-aa67-3c2126bdd209 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:47.890100 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46811bd6-6b35-4fa1-9773-320fd0c09ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:47.890729 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46811bd6-6b35-4fa1-9773-320fd0c09ffe None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:47.891015 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46811bd6-6b35-4fa1-9773-320fd0c09ffe None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:47.891329 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46811bd6-6b35-4fa1-9773-320fd0c09ffe None admin] PATH_INFO: `/v3/users` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:47.892151 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46811bd6-6b35-4fa1-9773-320fd0c09ffe None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:47.892463 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46811bd6-6b35-4fa1-9773-320fd0c09ffe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:47.893917 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46811bd6-6b35-4fa1-9773-320fd0c09ffe None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:47.910010 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:47.914669 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 268/539] 10.222.0.18 () {56 vars in 1133 bytes} [Tue Jul 26 15:25:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:47.921279 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4b2daf-45f6-453f-9ba6-e655a5887ac9 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:47.985387 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0cac2d-87aa-4c1f-b1aa-ffd8ebb08204 None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:47.985387 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0cac2d-87aa-4c1f-b1aa-ffd8ebb08204 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:47.985387 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0cac2d-87aa-4c1f-b1aa-ffd8ebb08204 None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:47.986172 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 269/540] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:25:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:25:47.992579 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cff2a2-d8d5-41f2-aa73-a935cbc0cee5 None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:47.992579 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cff2a2-d8d5-41f2-aa73-a935cbc0cee5 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:47.992579 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cff2a2-d8d5-41f2-aa73-a935cbc0cee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:48.014813 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-f3cff2a2-d8d5-41f2-aa73-a935cbc0cee5 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:25:48.016598 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-f3cff2a2-d8d5-41f2-aa73-a935cbc0cee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:25:48.088530 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4b2daf-45f6-453f-9ba6-e655a5887ac9 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:48.115637 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 270/541] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:25:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:25:48.134967 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933d662c-b5b5-4424-a5f9-30bb50b97650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:48.135935 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933d662c-b5b5-4424-a5f9-30bb50b97650 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:48.136928 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933d662c-b5b5-4424-a5f9-30bb50b97650 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:48.137351 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933d662c-b5b5-4424-a5f9-30bb50b97650 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:48.142086 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cff2a2-d8d5-41f2-aa73-a935cbc0cee5 None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:48.162695 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933d662c-b5b5-4424-a5f9-30bb50b97650 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:48.164911 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933d662c-b5b5-4424-a5f9-30bb50b97650 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:48.191005 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-933d662c-b5b5-4424-a5f9-30bb50b97650 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:25:48.191005 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:25:48.191005 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:25:48.191005 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:25:48.191005 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:25:48.191005 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:25:48.191005 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:25:48.191005 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:25:48.191005 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:25:48.191005 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:25:48.191005 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:25:48.191005 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:25:48.191005 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:25:48.191005 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:25:48.191005 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:25:48.192258 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:25:48.192258 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:25:48.192258 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:25:48.192258 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:25:48.192258 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:25:48.192258 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:25:48.192258 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:25:48.192258 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:25:48.192258 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:25:48.192258 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:25:48.192258 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:25:48.192258 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:25:48.192258 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:25:48.192258 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:25:48.192258 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:25:48.192258 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:25:48.192258 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:25:48.193694 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:25:48.193694 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:25:48.193694 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:25:48.193694 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:25:48.193694 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 272/542] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 15:25:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:25:48.198233 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933d662c-b5b5-4424-a5f9-30bb50b97650 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:48.269711 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:48.295480 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cff2a2-d8d5-41f2-aa73-a935cbc0cee5 None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:48.334760 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:48.338768 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933d662c-b5b5-4424-a5f9-30bb50b97650 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:48.342399 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e190319d-07fe-4285-aa63-8e4cfa4cbbd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:48.343062 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e190319d-07fe-4285-aa63-8e4cfa4cbbd5 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:48.344323 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e190319d-07fe-4285-aa63-8e4cfa4cbbd5 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:48.344614 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e190319d-07fe-4285-aa63-8e4cfa4cbbd5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:48.358515 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e190319d-07fe-4285-aa63-8e4cfa4cbbd5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:25:48.365118 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application [None req-e190319d-07fe-4285-aa63-8e4cfa4cbbd5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 15:25:48.365118 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:25:48.365118 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:25:48.365118 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:25:48.365118 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:25:48.365118 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:25:48.365118 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:25:48.365118 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:25:48.365118 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:25:48.365118 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:25:48.365118 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:25:48.365118 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:25:48.365118 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:25:48.365118 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:25:48.365118 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:25:48.365118 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:25:48.366409 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:25:48.366409 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:25:48.366409 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:25:48.366409 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:25:48.366409 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:25:48.366409 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:25:48.366409 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:25:48.366409 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:25:48.366409 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:25:48.366409 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:25:48.366409 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:25:48.366409 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application with Lock( Jul 26 15:25:48.366409 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:25:48.366409 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:25:48.366409 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:25:48.366409 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:25:48.367974 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:25:48.367974 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:25:48.367974 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:25:48.367974 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:25:48.367974 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:25:48.367974 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:25:48.367974 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:25:48.367974 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:25:48.367974 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:25:48.367974 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:25:48.367974 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 15:25:48.367974 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:25:48.367974 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 271/543] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jul 26 15:25:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:25:48.369183 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f62af11-779a-4093-bc95-8db2efc0f5f8 None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:48.369441 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f62af11-779a-4093-bc95-8db2efc0f5f8 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:48.369767 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f62af11-779a-4093-bc95-8db2efc0f5f8 None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:48.371990 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 272/544] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:25:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:25:48.377031 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f62af11-779a-4093-bc95-8db2efc0f5f8 None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:48.392158 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00137b7-14b1-48d5-a293-f8be10da972d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:48.392862 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00137b7-14b1-48d5-a293-f8be10da972d None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:48.393082 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00137b7-14b1-48d5-a293-f8be10da972d None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:48.393392 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00137b7-14b1-48d5-a293-f8be10da972d None admin] PATH_INFO: `/v3/domains` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:48.394152 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00137b7-14b1-48d5-a293-f8be10da972d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:48.394456 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00137b7-14b1-48d5-a293-f8be10da972d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:48.395930 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00137b7-14b1-48d5-a293-f8be10da972d None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:48.409941 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 273/545] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 15:25:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:48.411258 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab86640-4eac-4271-aae7-d6345fe5f389 None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:48.411547 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab86640-4eac-4271-aae7-d6345fe5f389 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:48.411815 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab86640-4eac-4271-aae7-d6345fe5f389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:48.437711 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-5ab86640-4eac-4271-aae7-d6345fe5f389 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:25:48.439864 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-5ab86640-4eac-4271-aae7-d6345fe5f389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:25:48.515592 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f62af11-779a-4093-bc95-8db2efc0f5f8 None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:48.530034 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 274/546] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:25:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:25:48.530802 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab86640-4eac-4271-aae7-d6345fe5f389 None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:48.576352 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceb4288-f9aa-454c-8998-6af92d83f077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:48.577450 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb4288-f9aa-454c-8998-6af92d83f077 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:48.578023 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb4288-f9aa-454c-8998-6af92d83f077 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:48.578465 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb4288-f9aa-454c-8998-6af92d83f077 None admin] PATH_INFO: `/v3/roles` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:48.580073 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceb4288-f9aa-454c-8998-6af92d83f077 None admin] RBAC: Adding query filter params (name=service) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:48.580649 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceb4288-f9aa-454c-8998-6af92d83f077 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:48.583243 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceb4288-f9aa-454c-8998-6af92d83f077 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:48.595466 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:48.603304 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 273/547] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jul 26 15:25:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:48.604814 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceb4288-f9aa-454c-8998-6af92d83f077 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:48.680559 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:48.689469 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab86640-4eac-4271-aae7-d6345fe5f389 None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:48.741764 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1824c9-e3c8-44f1-b0df-102a47ef9cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:48.742724 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1824c9-e3c8-44f1-b0df-102a47ef9cd4 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:48.743209 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1824c9-e3c8-44f1-b0df-102a47ef9cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:48.743717 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1824c9-e3c8-44f1-b0df-102a47ef9cd4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:48.756521 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1824c9-e3c8-44f1-b0df-102a47ef9cd4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:48.759341 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1824c9-e3c8-44f1-b0df-102a47ef9cd4 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:48.763909 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceb4288-f9aa-454c-8998-6af92d83f077 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:48.781760 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-da1824c9-e3c8-44f1-b0df-102a47ef9cd4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:25:48.781760 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:25:48.781760 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:25:48.781760 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:25:48.781760 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:25:48.781760 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:25:48.781760 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:25:48.781760 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:25:48.781760 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:25:48.781760 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:25:48.781760 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:25:48.781760 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:25:48.781760 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 15:25:48.781760 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 15:25:48.781760 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 15:25:48.782854 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 15:25:48.782854 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:25:48.782854 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:25:48.782854 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:25:48.782854 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:25:48.782854 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:25:48.782854 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:25:48.782854 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:25:48.782854 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:25:48.782854 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:25:48.782854 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:25:48.782854 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:25:48.782854 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:25:48.782854 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:25:48.782854 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:25:48.782854 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:25:48.782854 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:25:48.783833 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 15:25:48.783833 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 15:25:48.783833 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 15:25:48.783833 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 15:25:48.783833 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 15:25:48.783833 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 15:25:48.783833 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:25:48.783833 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:25:48.784729 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 275/548] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 15:25:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:25:48.785329 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1824c9-e3c8-44f1-b0df-102a47ef9cd4 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:48.813192 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0a621d-0dc4-4ca7-a5d8-54e819d7d63e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:48.814221 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a621d-0dc4-4ca7-a5d8-54e819d7d63e None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:48.814785 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a621d-0dc4-4ca7-a5d8-54e819d7d63e None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:48.815071 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a621d-0dc4-4ca7-a5d8-54e819d7d63e None admin] PATH_INFO: `/v3/roles/service` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:48.827687 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0a621d-0dc4-4ca7-a5d8-54e819d7d63e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:25:48.833622 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application [None req-ed0a621d-0dc4-4ca7-a5d8-54e819d7d63e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 15:25:48.833622 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:25:48.833622 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:25:48.833622 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:25:48.833622 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:25:48.833622 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:25:48.833622 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:25:48.833622 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:25:48.833622 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:25:48.833622 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:25:48.833622 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:25:48.833622 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:25:48.833622 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:25:48.833622 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:25:48.833622 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:25:48.833622 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:25:48.835674 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:25:48.835674 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:25:48.835674 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:25:48.835674 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:25:48.835674 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:25:48.835674 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:25:48.835674 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:25:48.835674 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:25:48.835674 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:25:48.835674 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:25:48.835674 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:25:48.835674 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application with Lock( Jul 26 15:25:48.835674 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:25:48.835674 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:25:48.835674 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:25:48.835674 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:25:48.837680 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:25:48.837680 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:25:48.837680 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:25:48.837680 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:25:48.837680 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:25:48.837680 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:25:48.837680 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:25:48.837680 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:25:48.837680 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:25:48.837680 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:25:48.837680 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 15:25:48.837680 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:25:48.837680 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 274/549] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jul 26 15:25:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:25:48.837680 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0a621d-0dc4-4ca7-a5d8-54e819d7d63e None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:48.904315 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:48.908925 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1824c9-e3c8-44f1-b0df-102a47ef9cd4 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:48.948234 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0a621d-0dc4-4ca7-a5d8-54e819d7d63e None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:48.950471 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d04a136-4be9-474e-aea0-975436e06b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:48.951139 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d04a136-4be9-474e-aea0-975436e06b4d None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:48.951442 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d04a136-4be9-474e-aea0-975436e06b4d None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:48.951719 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d04a136-4be9-474e-aea0-975436e06b4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:48.962861 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d04a136-4be9-474e-aea0-975436e06b4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:48.964384 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d04a136-4be9-474e-aea0-975436e06b4d None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:48.964791 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:48.983649 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-1d04a136-4be9-474e-aea0-975436e06b4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:25:48.983649 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:25:48.983649 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:25:48.983649 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:25:48.983649 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:25:48.983649 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:25:48.983649 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:25:48.983649 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:25:48.983649 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:25:48.983649 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:25:48.983649 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:25:48.983649 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:25:48.983649 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:25:48.983649 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:25:48.983649 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:25:48.985032 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:25:48.985032 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:25:48.985032 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:25:48.985032 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:25:48.985032 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:25:48.985032 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:25:48.985032 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:25:48.985032 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:25:48.985032 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:25:48.985032 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:25:48.985032 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:25:48.985032 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:25:48.985032 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:25:48.985032 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:25:48.985032 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:25:48.985032 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:25:48.985032 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:25:48.986773 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:25:48.986773 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:25:48.986773 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:25:48.986773 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:25:48.986773 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 276/550] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 15:25:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:25:48.986773 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d04a136-4be9-474e-aea0-975436e06b4d None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:48.992111 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d5880-c377-42f4-9f75-46d1c8afb8ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:48.992826 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d5880-c377-42f4-9f75-46d1c8afb8ec None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:48.993429 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d5880-c377-42f4-9f75-46d1c8afb8ec None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:48.993948 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d5880-c377-42f4-9f75-46d1c8afb8ec None admin] PATH_INFO: `/v3/projects` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:48.994999 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393d5880-c377-42f4-9f75-46d1c8afb8ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:48.995346 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393d5880-c377-42f4-9f75-46d1c8afb8ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:48.997375 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393d5880-c377-42f4-9f75-46d1c8afb8ec None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:49.015425 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 275/551] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jul 26 15:25:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:49.017618 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43465a30-ac2d-4bb8-bd3c-12376f648807 None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:49.018087 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43465a30-ac2d-4bb8-bd3c-12376f648807 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:49.018657 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43465a30-ac2d-4bb8-bd3c-12376f648807 None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:49.021345 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 276/552] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:25:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:25:49.022485 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43465a30-ac2d-4bb8-bd3c-12376f648807 None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:49.128330 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d04a136-4be9-474e-aea0-975436e06b4d None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:49.159216 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43465a30-ac2d-4bb8-bd3c-12376f648807 None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:49.165829 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f88f41-2767-42f1-9be1-da0ee6d6a877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:49.166455 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f88f41-2767-42f1-9be1-da0ee6d6a877 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:49.166737 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f88f41-2767-42f1-9be1-da0ee6d6a877 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:49.167243 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f88f41-2767-42f1-9be1-da0ee6d6a877 None admin] PATH_INFO: `/v3/roles` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:49.168560 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f88f41-2767-42f1-9be1-da0ee6d6a877 None admin] RBAC: Adding query filter params (name=service) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:49.168872 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f88f41-2767-42f1-9be1-da0ee6d6a877 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:49.170901 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f88f41-2767-42f1-9be1-da0ee6d6a877 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:49.180733 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 277/553] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jul 26 15:25:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:49.181573 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f88f41-2767-42f1-9be1-da0ee6d6a877 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:49.198283 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac05c41-3436-4183-b9f5-392271b0a7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:49.198962 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac05c41-3436-4183-b9f5-392271b0a7f6 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:49.199770 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac05c41-3436-4183-b9f5-392271b0a7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:49.199770 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac05c41-3436-4183-b9f5-392271b0a7f6 None admin] PATH_INFO: `/v3/domains` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:49.200334 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac05c41-3436-4183-b9f5-392271b0a7f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:49.200644 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac05c41-3436-4183-b9f5-392271b0a7f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:49.202066 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac05c41-3436-4183-b9f5-392271b0a7f6 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:49.208329 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:49.215409 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 277/554] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 15:25:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:49.216790 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c42c20c-2bac-4875-98d2-d7c24cf46830 None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:49.217089 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c42c20c-2bac-4875-98d2-d7c24cf46830 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:49.217503 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c42c20c-2bac-4875-98d2-d7c24cf46830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:49.237929 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-3c42c20c-2bac-4875-98d2-d7c24cf46830 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:25:49.239113 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-3c42c20c-2bac-4875-98d2-d7c24cf46830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:25:49.269979 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:49.309969 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f88f41-2767-42f1-9be1-da0ee6d6a877 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:49.318017 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 278/555] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:25:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:25:49.318892 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c42c20c-2bac-4875-98d2-d7c24cf46830 None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:49.350501 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217cb0de-5982-4400-ae0a-80dea954c2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:49.351221 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217cb0de-5982-4400-ae0a-80dea954c2e4 None admin] REQUEST_METHOD: `PUT` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:49.351506 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217cb0de-5982-4400-ae0a-80dea954c2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:49.351786 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217cb0de-5982-4400-ae0a-80dea954c2e4 None admin] PATH_INFO: `/v3/projects/9178e468facc41d6a7d828dfcd5301b4/users/fbc5f2b36d3f45f1b3c8155e46c46fda/roles/2a6f012a2a004fbb8ab4d8a5f8633a22` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:49.369594 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217cb0de-5982-4400-ae0a-80dea954c2e4 None admin] RBAC: Authorizing `identity:create_grant(project_id=9178e468facc41d6a7d828dfcd5301b4, user_id=fbc5f2b36d3f45f1b3c8155e46c46fda, role_id=2a6f012a2a004fbb8ab4d8a5f8633a22)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:49.371116 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217cb0de-5982-4400-ae0a-80dea954c2e4 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:49.444562 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c42c20c-2bac-4875-98d2-d7c24cf46830 None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:49.444776 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 278/556] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jul 26 15:25:49 2022] PUT /identity/v3/projects/9178e468facc41d6a7d828dfcd5301b4/users/fbc5f2b36d3f45f1b3c8155e46c46fda/roles/2a6f012a2a004fbb8ab4d8a5f8633a22 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:25:49.446240 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217cb0de-5982-4400-ae0a-80dea954c2e4 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:49.494984 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae00e23-5b3b-4f1c-b516-8a19d7018c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:49.496414 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae00e23-5b3b-4f1c-b516-8a19d7018c90 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:49.496598 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae00e23-5b3b-4f1c-b516-8a19d7018c90 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:49.496847 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae00e23-5b3b-4f1c-b516-8a19d7018c90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:49.509822 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae00e23-5b3b-4f1c-b516-8a19d7018c90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:49.511488 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae00e23-5b3b-4f1c-b516-8a19d7018c90 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:49.529422 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application [None req-1ae00e23-5b3b-4f1c-b516-8a19d7018c90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:25:49.529422 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:25:49.529422 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:25:49.529422 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:25:49.529422 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:25:49.529422 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:25:49.529422 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:25:49.529422 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:25:49.529422 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:25:49.529422 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:25:49.529422 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:25:49.529422 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:25:49.529422 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:25:49.529422 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:25:49.529422 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:25:49.539246 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:25:49.539246 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:25:49.539246 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:25:49.539246 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:25:49.539246 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:25:49.539246 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:25:49.539246 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:25:49.539246 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:25:49.539246 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application with Lock( Jul 26 15:25:49.539246 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:25:49.539246 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:25:49.539246 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:25:49.539246 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:25:49.539246 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:25:49.539246 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:25:49.539246 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:25:49.539246 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:25:49.541199 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:25:49.541199 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:25:49.541199 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:25:49.541199 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:25:49.541199 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 279/557] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 15:25:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:25:49.541199 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae00e23-5b3b-4f1c-b516-8a19d7018c90 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:49.557267 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:49.586975 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:49.657236 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217cb0de-5982-4400-ae0a-80dea954c2e4 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:49.700995 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae00e23-5b3b-4f1c-b516-8a19d7018c90 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:49.704352 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9771bf-2f29-46cc-a5d1-8e21ea71f144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:49.705020 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9771bf-2f29-46cc-a5d1-8e21ea71f144 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:49.706015 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9771bf-2f29-46cc-a5d1-8e21ea71f144 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:49.706015 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9771bf-2f29-46cc-a5d1-8e21ea71f144 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:49.714356 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9771bf-2f29-46cc-a5d1-8e21ea71f144 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:49.716145 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9771bf-2f29-46cc-a5d1-8e21ea71f144 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:49.729484 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-9c9771bf-2f29-46cc-a5d1-8e21ea71f144 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 26 15:25:49.729484 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:25:49.729484 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:25:49.729484 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:25:49.729484 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:25:49.729484 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:25:49.729484 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:25:49.729484 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:25:49.729484 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:25:49.729484 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:25:49.729484 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:25:49.729484 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:25:49.729484 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 15:25:49.729484 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 15:25:49.729484 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 15:25:49.729484 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 15:25:49.731838 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:25:49.731838 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:25:49.731838 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 15:25:49.731838 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:25:49.731838 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 15:25:49.731838 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:25:49.731838 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:25:49.731838 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:25:49.731838 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:25:49.731838 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:25:49.731838 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:25:49.731838 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:25:49.731838 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:25:49.731838 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:25:49.731838 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:25:49.731838 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:25:49.731838 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:25:49.731838 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:25:49.734024 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:25:49.734024 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:25:49.734024 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 15:25:49.734024 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 15:25:49.734024 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 15:25:49.734024 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 15:25:49.734024 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 15:25:49.734024 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 15:25:49.734024 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 26 15:25:49.734024 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:25:49.736896 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 279/558] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jul 26 15:25:49 2022] GET /identity/v3/users/neutron => generated 85 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:25:49.737839 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9771bf-2f29-46cc-a5d1-8e21ea71f144 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:49.776179 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691c6dc1-eff3-428a-9a7e-50da0d8427cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:49.778060 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c6dc1-eff3-428a-9a7e-50da0d8427cf None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:49.778691 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c6dc1-eff3-428a-9a7e-50da0d8427cf None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:49.779330 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c6dc1-eff3-428a-9a7e-50da0d8427cf None admin] PATH_INFO: `/v3/roles/service` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:49.797751 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691c6dc1-eff3-428a-9a7e-50da0d8427cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:25:49.803714 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application [None req-691c6dc1-eff3-428a-9a7e-50da0d8427cf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 15:25:49.803714 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:25:49.803714 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:25:49.803714 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:25:49.803714 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:25:49.803714 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:25:49.803714 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:25:49.803714 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:25:49.803714 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:25:49.803714 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:25:49.803714 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:25:49.803714 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:25:49.803714 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:25:49.803714 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:25:49.803714 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:25:49.803714 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:25:49.810091 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:25:49.810091 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:25:49.810091 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:25:49.810091 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:25:49.810091 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:25:49.810091 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:25:49.810091 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:25:49.810091 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:25:49.810091 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:25:49.810091 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:25:49.810091 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:25:49.810091 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application with Lock( Jul 26 15:25:49.810091 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:25:49.810091 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:25:49.810091 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:25:49.810091 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:25:49.812089 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:25:49.812089 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:25:49.812089 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:25:49.812089 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:25:49.812089 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:25:49.812089 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:25:49.812089 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:25:49.812089 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:25:49.812089 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:25:49.812089 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:25:49.812089 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 15:25:49.812089 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:25:49.812089 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 280/559] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jul 26 15:25:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:25:49.812089 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691c6dc1-eff3-428a-9a7e-50da0d8427cf None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:49.915039 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:49.926547 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9771bf-2f29-46cc-a5d1-8e21ea71f144 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:49.961845 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:49.968522 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691c6dc1-eff3-428a-9a7e-50da0d8427cf None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:49.981370 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d5dc7b-9fbe-48e6-ab6a-c87392f672bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:49.982328 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d5dc7b-9fbe-48e6-ab6a-c87392f672bf None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:49.982836 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d5dc7b-9fbe-48e6-ab6a-c87392f672bf None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:49.983351 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d5dc7b-9fbe-48e6-ab6a-c87392f672bf None admin] PATH_INFO: `/v3/domains` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:49.984649 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d5dc7b-9fbe-48e6-ab6a-c87392f672bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:49.985216 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d5dc7b-9fbe-48e6-ab6a-c87392f672bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:49.987474 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d5dc7b-9fbe-48e6-ab6a-c87392f672bf None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:50.007064 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 280/560] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 15:25:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:50.008950 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d5dc7b-9fbe-48e6-ab6a-c87392f672bf None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:50.034771 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0279d516-7e29-46e7-a9db-52629b4d2fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:50.035840 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279d516-7e29-46e7-a9db-52629b4d2fa8 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:50.036321 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279d516-7e29-46e7-a9db-52629b4d2fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:50.036798 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279d516-7e29-46e7-a9db-52629b4d2fa8 None admin] PATH_INFO: `/v3/users` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:50.038323 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0279d516-7e29-46e7-a9db-52629b4d2fa8 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:50.038879 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0279d516-7e29-46e7-a9db-52629b4d2fa8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:50.041530 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0279d516-7e29-46e7-a9db-52629b4d2fa8 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:50.084941 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 281/561] 10.222.0.18 () {56 vars in 1139 bytes} [Tue Jul 26 15:25:49 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:50.084941 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0279d516-7e29-46e7-a9db-52629b4d2fa8 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:50.174354 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d5dc7b-9fbe-48e6-ab6a-c87392f672bf None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:50.234855 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1252c0-e017-4418-a898-88d8253ab77d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:50.235843 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1252c0-e017-4418-a898-88d8253ab77d None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:50.236118 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1252c0-e017-4418-a898-88d8253ab77d None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:50.236397 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1252c0-e017-4418-a898-88d8253ab77d None admin] PATH_INFO: `/v3/roles` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:50.237290 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1252c0-e017-4418-a898-88d8253ab77d None admin] RBAC: Adding query filter params (name=service) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:50.237595 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1252c0-e017-4418-a898-88d8253ab77d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:50.239216 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1252c0-e017-4418-a898-88d8253ab77d None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:50.240292 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0279d516-7e29-46e7-a9db-52629b4d2fa8 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:50.256212 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 281/562] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jul 26 15:25:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:50.256212 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1252c0-e017-4418-a898-88d8253ab77d None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:50.298468 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:50.307312 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb984f9-d597-43d0-ae75-47fc61ad8bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:50.308520 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb984f9-d597-43d0-ae75-47fc61ad8bf6 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:50.309004 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb984f9-d597-43d0-ae75-47fc61ad8bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:50.309579 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb984f9-d597-43d0-ae75-47fc61ad8bf6 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:50.318163 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:50.323166 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb984f9-d597-43d0-ae75-47fc61ad8bf6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:50.326952 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb984f9-d597-43d0-ae75-47fc61ad8bf6 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:50.350811 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application [None req-beb984f9-d597-43d0-ae75-47fc61ad8bf6 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 26 15:25:50.350811 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:25:50.350811 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:25:50.350811 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:25:50.350811 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:25:50.350811 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:25:50.350811 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:25:50.350811 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:25:50.350811 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:25:50.350811 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:25:50.350811 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:25:50.350811 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:25:50.350811 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 15:25:50.350811 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 15:25:50.350811 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 15:25:50.350811 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 15:25:50.352026 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:25:50.352026 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:25:50.352026 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 15:25:50.352026 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:25:50.352026 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 15:25:50.352026 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:25:50.352026 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:25:50.352026 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:25:50.352026 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:25:50.352026 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:25:50.352026 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:25:50.352026 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application with Lock( Jul 26 15:25:50.352026 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:25:50.352026 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:25:50.352026 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:25:50.352026 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:25:50.352026 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:25:50.352026 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:25:50.352945 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:25:50.352945 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:25:50.352945 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 15:25:50.352945 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 15:25:50.352945 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 15:25:50.352945 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 15:25:50.352945 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 15:25:50.352945 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 15:25:50.352945 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 26 15:25:50.352945 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:25:50.359649 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 282/563] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 15:25:50 2022] GET /identity/v3/users/glance => generated 84 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:25:50.361007 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb984f9-d597-43d0-ae75-47fc61ad8bf6 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:50.425826 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1252c0-e017-4418-a898-88d8253ab77d None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:50.476941 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6faafef-7de3-468f-a9a7-b51be60435da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:50.478031 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6faafef-7de3-468f-a9a7-b51be60435da None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:50.478537 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6faafef-7de3-468f-a9a7-b51be60435da None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:50.479086 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6faafef-7de3-468f-a9a7-b51be60435da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:50.500178 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6faafef-7de3-468f-a9a7-b51be60435da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:50.501645 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb984f9-d597-43d0-ae75-47fc61ad8bf6 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:50.502807 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6faafef-7de3-468f-a9a7-b51be60435da None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:50.529276 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-f6faafef-7de3-468f-a9a7-b51be60435da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:25:50.529276 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:25:50.529276 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:25:50.529276 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:25:50.529276 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:25:50.529276 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:25:50.529276 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:25:50.529276 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:25:50.529276 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:25:50.529276 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:25:50.529276 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:25:50.529276 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:25:50.529276 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:25:50.529276 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:25:50.529276 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:25:50.530340 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:25:50.530340 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:25:50.530340 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:25:50.530340 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:25:50.530340 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:25:50.530340 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:25:50.530340 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:25:50.530340 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:25:50.530340 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:25:50.530340 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:25:50.530340 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:25:50.530340 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:25:50.530340 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:25:50.530340 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:25:50.530340 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:25:50.530340 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:25:50.530340 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:25:50.531359 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:25:50.531359 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:25:50.531359 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:25:50.531359 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:25:50.531603 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 282/564] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 15:25:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:25:50.532831 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6faafef-7de3-468f-a9a7-b51be60435da None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:50.559921 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9243cb38-9006-45c0-a7dc-6aee8a650f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:50.561302 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9243cb38-9006-45c0-a7dc-6aee8a650f07 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:50.562046 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9243cb38-9006-45c0-a7dc-6aee8a650f07 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:50.562688 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9243cb38-9006-45c0-a7dc-6aee8a650f07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:50.579706 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9243cb38-9006-45c0-a7dc-6aee8a650f07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:50.581549 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9243cb38-9006-45c0-a7dc-6aee8a650f07 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:50.599429 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application [None req-9243cb38-9006-45c0-a7dc-6aee8a650f07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:25:50.599429 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:25:50.599429 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:25:50.599429 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:25:50.599429 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:25:50.599429 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:25:50.599429 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:25:50.599429 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:25:50.599429 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:25:50.599429 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:25:50.599429 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:25:50.599429 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:25:50.599429 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:25:50.599429 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:25:50.599429 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:25:50.601200 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:25:50.601200 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:25:50.601200 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:25:50.601200 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:25:50.601200 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:25:50.601200 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:25:50.601200 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:25:50.601200 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:25:50.601200 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application with Lock( Jul 26 15:25:50.601200 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:25:50.601200 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:25:50.601200 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:25:50.601200 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:25:50.601200 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:25:50.601200 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:25:50.601200 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:25:50.601200 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:25:50.602928 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:25:50.602928 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:25:50.602928 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:25:50.602928 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:25:50.607437 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 283/565] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 15:25:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:25:50.609652 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9243cb38-9006-45c0-a7dc-6aee8a650f07 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:50.700787 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:50.702160 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:50.712444 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6faafef-7de3-468f-a9a7-b51be60435da None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:50.778025 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23a3877-3a8d-4c0e-ae1f-e0dbaff9fea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:50.778984 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a3877-3a8d-4c0e-ae1f-e0dbaff9fea1 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:50.779540 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a3877-3a8d-4c0e-ae1f-e0dbaff9fea1 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:50.780035 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a3877-3a8d-4c0e-ae1f-e0dbaff9fea1 None admin] PATH_INFO: `/v3/users` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:50.781732 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23a3877-3a8d-4c0e-ae1f-e0dbaff9fea1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:50.782293 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23a3877-3a8d-4c0e-ae1f-e0dbaff9fea1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:50.785227 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23a3877-3a8d-4c0e-ae1f-e0dbaff9fea1 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:50.786403 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9243cb38-9006-45c0-a7dc-6aee8a650f07 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:50.820711 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 283/566] 10.222.0.18 () {56 vars in 1137 bytes} [Tue Jul 26 15:25:50 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:50.821871 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23a3877-3a8d-4c0e-ae1f-e0dbaff9fea1 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:50.842686 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867819d6-a4c0-448d-b18e-1c77861b0057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:50.843365 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867819d6-a4c0-448d-b18e-1c77861b0057 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:50.843649 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867819d6-a4c0-448d-b18e-1c77861b0057 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:50.843933 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867819d6-a4c0-448d-b18e-1c77861b0057 None admin] PATH_INFO: `/v3/domains` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:50.844630 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867819d6-a4c0-448d-b18e-1c77861b0057 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:50.844949 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867819d6-a4c0-448d-b18e-1c77861b0057 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:50.846935 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867819d6-a4c0-448d-b18e-1c77861b0057 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:50.862846 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 284/567] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 15:25:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:50.869739 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867819d6-a4c0-448d-b18e-1c77861b0057 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:51.036453 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23a3877-3a8d-4c0e-ae1f-e0dbaff9fea1 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:51.044950 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867819d6-a4c0-448d-b18e-1c77861b0057 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:51.049994 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:51.080129 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f28fcc-0388-4b68-b9e9-79712bcc707b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:51.082159 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f28fcc-0388-4b68-b9e9-79712bcc707b None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:51.082159 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f28fcc-0388-4b68-b9e9-79712bcc707b None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:51.082159 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f28fcc-0388-4b68-b9e9-79712bcc707b None admin] PATH_INFO: `/v3/domains` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:51.082159 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f28fcc-0388-4b68-b9e9-79712bcc707b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:51.082690 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f28fcc-0388-4b68-b9e9-79712bcc707b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:51.083832 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f28fcc-0388-4b68-b9e9-79712bcc707b None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:51.101523 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c4cdbc-b9a4-47c1-b3c7-00f38b8210c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:51.102076 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 284/568] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 15:25:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:51.102568 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c4cdbc-b9a4-47c1-b3c7-00f38b8210c1 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:51.103047 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c4cdbc-b9a4-47c1-b3c7-00f38b8210c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:51.103573 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c4cdbc-b9a4-47c1-b3c7-00f38b8210c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:51.104621 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f28fcc-0388-4b68-b9e9-79712bcc707b None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:51.125511 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c4cdbc-b9a4-47c1-b3c7-00f38b8210c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:51.128113 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c4cdbc-b9a4-47c1-b3c7-00f38b8210c1 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:51.137600 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:51.155720 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application [None req-a2c4cdbc-b9a4-47c1-b3c7-00f38b8210c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:25:51.155720 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:25:51.155720 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:25:51.155720 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:25:51.155720 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:25:51.155720 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:25:51.155720 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:25:51.155720 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:25:51.155720 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:25:51.155720 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:25:51.155720 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:25:51.155720 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:25:51.155720 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:25:51.155720 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:25:51.155720 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:25:51.156666 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:25:51.156666 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:25:51.156666 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:25:51.156666 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:25:51.156666 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:25:51.156666 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:25:51.156666 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:25:51.156666 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:25:51.156666 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application with Lock( Jul 26 15:25:51.156666 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:25:51.156666 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:25:51.156666 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:25:51.156666 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:25:51.156666 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:25:51.156666 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:25:51.156666 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:25:51.156666 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:25:51.157588 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:25:51.157588 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:25:51.157588 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:25:51.157588 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:25:51.157588 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 285/569] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 15:25:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:25:51.158733 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c4cdbc-b9a4-47c1-b3c7-00f38b8210c1 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:51.273112 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f28fcc-0388-4b68-b9e9-79712bcc707b None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:51.317928 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f80415-d7ce-4b4a-aecf-51596207d094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:51.318680 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f80415-d7ce-4b4a-aecf-51596207d094 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:51.319052 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f80415-d7ce-4b4a-aecf-51596207d094 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:51.319452 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f80415-d7ce-4b4a-aecf-51596207d094 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:51.320321 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c4cdbc-b9a4-47c1-b3c7-00f38b8210c1 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:51.329220 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f80415-d7ce-4b4a-aecf-51596207d094 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:51.330731 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f80415-d7ce-4b4a-aecf-51596207d094 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:51.346983 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-37f80415-d7ce-4b4a-aecf-51596207d094 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:25:51.346983 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:25:51.346983 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:25:51.346983 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:25:51.346983 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:25:51.346983 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:25:51.346983 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:25:51.346983 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:25:51.346983 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:25:51.346983 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:25:51.346983 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:25:51.346983 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:25:51.346983 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 15:25:51.346983 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 15:25:51.346983 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 15:25:51.354252 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 15:25:51.354252 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:25:51.354252 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:25:51.354252 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:25:51.354252 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:25:51.354252 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:25:51.354252 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:25:51.354252 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:25:51.354252 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:25:51.354252 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:25:51.354252 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:25:51.354252 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:25:51.354252 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:25:51.354252 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:25:51.354252 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:25:51.354252 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:25:51.354252 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:25:51.355513 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 15:25:51.355513 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 15:25:51.355513 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 15:25:51.355513 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 15:25:51.355513 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 15:25:51.355513 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 15:25:51.355513 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:25:51.355513 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:25:51.355513 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 285/570] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 15:25:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:25:51.355513 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f80415-d7ce-4b4a-aecf-51596207d094 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:51.382355 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9405fa8e-bd2f-4779-b1a8-75218209f529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:51.383367 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9405fa8e-bd2f-4779-b1a8-75218209f529 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:51.383803 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9405fa8e-bd2f-4779-b1a8-75218209f529 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:51.384227 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9405fa8e-bd2f-4779-b1a8-75218209f529 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:51.396274 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9405fa8e-bd2f-4779-b1a8-75218209f529 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:51.397769 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9405fa8e-bd2f-4779-b1a8-75218209f529 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:51.412329 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application [None req-9405fa8e-bd2f-4779-b1a8-75218209f529 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 15:25:51.412329 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:25:51.412329 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:25:51.412329 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:25:51.412329 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:25:51.412329 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:25:51.412329 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:25:51.412329 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:25:51.412329 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:25:51.412329 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:25:51.412329 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:25:51.412329 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:25:51.412329 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 15:25:51.412329 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 15:25:51.412329 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 15:25:51.412329 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 15:25:51.419458 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:25:51.419458 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:25:51.419458 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 15:25:51.419458 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:25:51.419458 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 15:25:51.419458 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:25:51.419458 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:25:51.419458 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:25:51.419458 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:25:51.419458 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:25:51.419458 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:25:51.419458 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application with Lock( Jul 26 15:25:51.419458 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:25:51.419458 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:25:51.419458 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:25:51.419458 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:25:51.419458 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:25:51.419458 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:25:51.420614 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:25:51.420614 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:25:51.420614 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 15:25:51.420614 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 15:25:51.420614 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 15:25:51.420614 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 15:25:51.420614 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 15:25:51.420614 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 15:25:51.420614 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 15:25:51.420614 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:25:51.420614 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 286/571] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 15:25:51 2022] GET /identity/v3/users/cinder => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:25:51.420614 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9405fa8e-bd2f-4779-b1a8-75218209f529 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:51.436993 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:51.471628 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:51.528873 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f80415-d7ce-4b4a-aecf-51596207d094 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:51.591992 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49c82df-91b2-4422-ac17-a3dc363e37c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:51.592944 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c82df-91b2-4422-ac17-a3dc363e37c3 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:51.593552 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c82df-91b2-4422-ac17-a3dc363e37c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:51.594030 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c82df-91b2-4422-ac17-a3dc363e37c3 None admin] PATH_INFO: `/v3/domains` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:51.595316 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49c82df-91b2-4422-ac17-a3dc363e37c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:51.595917 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49c82df-91b2-4422-ac17-a3dc363e37c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:51.598227 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49c82df-91b2-4422-ac17-a3dc363e37c3 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:51.602147 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9405fa8e-bd2f-4779-b1a8-75218209f529 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:51.620277 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 286/572] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 15:25:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:51.622480 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49c82df-91b2-4422-ac17-a3dc363e37c3 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:51.677819 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc8591-efcf-443a-95bc-7abd06ea4ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:51.678716 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc8591-efcf-443a-95bc-7abd06ea4ba1 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:51.679456 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc8591-efcf-443a-95bc-7abd06ea4ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:51.679934 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc8591-efcf-443a-95bc-7abd06ea4ba1 None admin] PATH_INFO: `/v3/projects` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:51.681266 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbc8591-efcf-443a-95bc-7abd06ea4ba1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:51.681840 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbc8591-efcf-443a-95bc-7abd06ea4ba1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:51.684401 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbc8591-efcf-443a-95bc-7abd06ea4ba1 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:51.709553 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 287/573] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jul 26 15:25:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:51.709553 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc8591-efcf-443a-95bc-7abd06ea4ba1 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:51.828697 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:51.845035 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49c82df-91b2-4422-ac17-a3dc363e37c3 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:51.858978 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc8591-efcf-443a-95bc-7abd06ea4ba1 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:51.916845 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc49618-ccc2-4ffe-a6cb-4b44b33b09a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:51.918630 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc49618-ccc2-4ffe-a6cb-4b44b33b09a0 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:51.919113 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc49618-ccc2-4ffe-a6cb-4b44b33b09a0 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:51.919611 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc49618-ccc2-4ffe-a6cb-4b44b33b09a0 None admin] PATH_INFO: `/v3/users` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:51.920920 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd4d690-4762-4e04-993b-24b9a92a5d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:51.921159 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc49618-ccc2-4ffe-a6cb-4b44b33b09a0 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:51.921476 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc49618-ccc2-4ffe-a6cb-4b44b33b09a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:51.922169 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd4d690-4762-4e04-993b-24b9a92a5d91 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:51.922668 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd4d690-4762-4e04-993b-24b9a92a5d91 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:51.923226 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd4d690-4762-4e04-993b-24b9a92a5d91 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:51.924121 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc49618-ccc2-4ffe-a6cb-4b44b33b09a0 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:51.932023 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:51.942433 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd4d690-4762-4e04-993b-24b9a92a5d91 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:51.945184 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd4d690-4762-4e04-993b-24b9a92a5d91 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:51.968763 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 287/574] 10.222.0.18 () {56 vars in 1137 bytes} [Tue Jul 26 15:25:51 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:51.968763 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc49618-ccc2-4ffe-a6cb-4b44b33b09a0 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:51.969171 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application [None req-4bd4d690-4762-4e04-993b-24b9a92a5d91 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:25:51.969171 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:25:51.969171 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:25:51.969171 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:25:51.969171 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:25:51.969171 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:25:51.969171 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:25:51.969171 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:25:51.969171 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:25:51.969171 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:25:51.969171 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:25:51.969171 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:25:51.969171 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 15:25:51.969171 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 15:25:51.969171 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 15:25:51.972880 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 15:25:51.972880 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:25:51.972880 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:25:51.972880 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:25:51.972880 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:25:51.972880 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:25:51.972880 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:25:51.972880 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:25:51.972880 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application with Lock( Jul 26 15:25:51.972880 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:25:51.972880 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:25:51.972880 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:25:51.972880 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:25:51.972880 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:25:51.972880 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:25:51.972880 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:25:51.972880 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:25:51.974595 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 15:25:51.974595 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 15:25:51.974595 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 15:25:51.974595 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 15:25:51.974595 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 15:25:51.974595 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 15:25:51.974595 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:25:51.974595 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:25:51.974595 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 288/575] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 15:25:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:25:51.976460 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd4d690-4762-4e04-993b-24b9a92a5d91 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:52.114435 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd4d690-4762-4e04-993b-24b9a92a5d91 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:52.151016 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc49618-ccc2-4ffe-a6cb-4b44b33b09a0 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:52.163992 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ee8394-37bd-4cfe-8cd5-29e3c9fd75b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:52.164788 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ee8394-37bd-4cfe-8cd5-29e3c9fd75b2 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:52.165182 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ee8394-37bd-4cfe-8cd5-29e3c9fd75b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:52.165643 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ee8394-37bd-4cfe-8cd5-29e3c9fd75b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:52.170582 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:52.180826 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ee8394-37bd-4cfe-8cd5-29e3c9fd75b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:52.182372 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ee8394-37bd-4cfe-8cd5-29e3c9fd75b2 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:52.199203 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application [None req-96ee8394-37bd-4cfe-8cd5-29e3c9fd75b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:25:52.199203 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:25:52.199203 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:25:52.199203 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:25:52.199203 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:25:52.199203 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:25:52.199203 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:25:52.199203 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:25:52.199203 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:25:52.199203 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:25:52.199203 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:25:52.199203 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:25:52.199203 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:25:52.199203 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:25:52.199203 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:25:52.201229 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:25:52.201229 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:25:52.201229 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:25:52.201229 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:25:52.201229 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:25:52.201229 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:25:52.201229 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:25:52.201229 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:25:52.201229 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application with Lock( Jul 26 15:25:52.201229 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:25:52.201229 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:25:52.201229 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:25:52.201229 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:25:52.201229 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:25:52.201229 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:25:52.201229 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:25:52.201229 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:25:52.203347 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:25:52.203347 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:25:52.203347 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:25:52.203347 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:25:52.203347 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 289/576] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 15:25:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:25:52.203347 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ee8394-37bd-4cfe-8cd5-29e3c9fd75b2 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:52.211290 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3122b030-1907-44f6-897c-29f5961b5919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:52.212006 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3122b030-1907-44f6-897c-29f5961b5919 None admin] REQUEST_METHOD: `PUT` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:52.212289 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3122b030-1907-44f6-897c-29f5961b5919 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:52.212598 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3122b030-1907-44f6-897c-29f5961b5919 None admin] PATH_INFO: `/v3/projects/9178e468facc41d6a7d828dfcd5301b4/users/960c230d1e8841e6b231fdbf4d172cc6/roles/2a6f012a2a004fbb8ab4d8a5f8633a22` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:52.230945 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3122b030-1907-44f6-897c-29f5961b5919 None admin] RBAC: Authorizing `identity:create_grant(project_id=9178e468facc41d6a7d828dfcd5301b4, user_id=960c230d1e8841e6b231fdbf4d172cc6, role_id=2a6f012a2a004fbb8ab4d8a5f8633a22)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:52.232480 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3122b030-1907-44f6-897c-29f5961b5919 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:52.304190 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 288/577] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jul 26 15:25:51 2022] PUT /identity/v3/projects/9178e468facc41d6a7d828dfcd5301b4/users/960c230d1e8841e6b231fdbf4d172cc6/roles/2a6f012a2a004fbb8ab4d8a5f8633a22 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:25:52.305595 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87478708-0ead-4a9b-9518-b0d2b48560fb None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:52.305895 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87478708-0ead-4a9b-9518-b0d2b48560fb None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:52.306185 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87478708-0ead-4a9b-9518-b0d2b48560fb None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:52.307581 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 289/578] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:25:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:25:52.309017 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87478708-0ead-4a9b-9518-b0d2b48560fb None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:52.353814 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ee8394-37bd-4cfe-8cd5-29e3c9fd75b2 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:52.388318 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:52.420472 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f091aaed-0a29-4f7a-b61d-0d1998373822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:52.421793 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091aaed-0a29-4f7a-b61d-0d1998373822 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:52.423543 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091aaed-0a29-4f7a-b61d-0d1998373822 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:52.423848 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091aaed-0a29-4f7a-b61d-0d1998373822 None admin] PATH_INFO: `/v3/projects` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:52.427969 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f091aaed-0a29-4f7a-b61d-0d1998373822 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:52.428496 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f091aaed-0a29-4f7a-b61d-0d1998373822 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:52.432144 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f091aaed-0a29-4f7a-b61d-0d1998373822 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:52.454152 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 290/579] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jul 26 15:25:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:52.456509 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a225eb0-f9b2-4b13-8463-43de3ef87ab8 None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:52.457031 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a225eb0-f9b2-4b13-8463-43de3ef87ab8 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:52.457408 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a225eb0-f9b2-4b13-8463-43de3ef87ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:52.479634 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-0a225eb0-f9b2-4b13-8463-43de3ef87ab8 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:25:52.480288 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87478708-0ead-4a9b-9518-b0d2b48560fb None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:52.481230 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-0a225eb0-f9b2-4b13-8463-43de3ef87ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:25:52.549624 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:52.555367 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6b77ba-cf9e-4025-b7aa-36d223d33302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:52.556016 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b77ba-cf9e-4025-b7aa-36d223d33302 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:52.556302 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b77ba-cf9e-4025-b7aa-36d223d33302 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:52.556601 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b77ba-cf9e-4025-b7aa-36d223d33302 None admin] PATH_INFO: `/v3/domains` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:52.557339 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6b77ba-cf9e-4025-b7aa-36d223d33302 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:52.557648 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6b77ba-cf9e-4025-b7aa-36d223d33302 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:52.559333 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6b77ba-cf9e-4025-b7aa-36d223d33302 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:52.572275 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 290/580] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 15:25:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:52.578641 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6b77ba-cf9e-4025-b7aa-36d223d33302 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:52.586762 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 291/581] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:25:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:25:52.587739 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a225eb0-f9b2-4b13-8463-43de3ef87ab8 None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:52.750640 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a225eb0-f9b2-4b13-8463-43de3ef87ab8 None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:52.754250 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6b77ba-cf9e-4025-b7aa-36d223d33302 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:52.756026 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:52.795544 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dc7719-8bcf-4022-834b-98b61ed4c7b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:52.797006 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc7719-8bcf-4022-834b-98b61ed4c7b7 None admin] REQUEST_METHOD: `PUT` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:52.797539 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc7719-8bcf-4022-834b-98b61ed4c7b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:52.798074 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc7719-8bcf-4022-834b-98b61ed4c7b7 None admin] PATH_INFO: `/v3/projects/9178e468facc41d6a7d828dfcd5301b4/users/d903ca1082154ef2bfac7156d22ddac6/roles/2a6f012a2a004fbb8ab4d8a5f8633a22` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:52.806864 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768591ce-094b-4504-b543-5fec18a9a1a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:52.807714 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768591ce-094b-4504-b543-5fec18a9a1a2 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:52.808141 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768591ce-094b-4504-b543-5fec18a9a1a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:52.808518 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768591ce-094b-4504-b543-5fec18a9a1a2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:52.816152 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768591ce-094b-4504-b543-5fec18a9a1a2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:52.817786 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768591ce-094b-4504-b543-5fec18a9a1a2 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:52.823204 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dc7719-8bcf-4022-834b-98b61ed4c7b7 None admin] RBAC: Authorizing `identity:create_grant(project_id=9178e468facc41d6a7d828dfcd5301b4, user_id=d903ca1082154ef2bfac7156d22ddac6, role_id=2a6f012a2a004fbb8ab4d8a5f8633a22)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:52.826311 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dc7719-8bcf-4022-834b-98b61ed4c7b7 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:52.832448 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application [None req-768591ce-094b-4504-b543-5fec18a9a1a2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:25:52.832448 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:25:52.832448 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:25:52.832448 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:25:52.832448 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:25:52.832448 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:25:52.832448 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:25:52.832448 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:25:52.832448 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:25:52.832448 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:25:52.832448 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:25:52.832448 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:25:52.832448 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 15:25:52.832448 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 15:25:52.832448 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 15:25:52.834573 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 15:25:52.834573 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:25:52.834573 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:25:52.834573 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:25:52.834573 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:25:52.834573 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:25:52.834573 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:25:52.834573 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:25:52.834573 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application with Lock( Jul 26 15:25:52.834573 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:25:52.834573 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:25:52.834573 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:25:52.834573 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:25:52.834573 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:25:52.834573 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:25:52.834573 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:25:52.834573 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:25:52.836471 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 15:25:52.836471 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 15:25:52.836471 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 15:25:52.836471 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 15:25:52.836471 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 15:25:52.836471 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 15:25:52.836471 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:25:52.836471 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:25:52.836471 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 292/582] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 15:25:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:25:52.836471 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768591ce-094b-4504-b543-5fec18a9a1a2 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:52.892689 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:52.970465 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 291/583] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jul 26 15:25:52 2022] PUT /identity/v3/projects/9178e468facc41d6a7d828dfcd5301b4/users/d903ca1082154ef2bfac7156d22ddac6/roles/2a6f012a2a004fbb8ab4d8a5f8633a22 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:25:52.970465 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dc7719-8bcf-4022-834b-98b61ed4c7b7 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:53.020413 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768591ce-094b-4504-b543-5fec18a9a1a2 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:53.102926 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93159383-b270-41d9-97a2-f3d02b0c36dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:53.103922 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93159383-b270-41d9-97a2-f3d02b0c36dc None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:53.104310 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93159383-b270-41d9-97a2-f3d02b0c36dc None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:53.104691 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93159383-b270-41d9-97a2-f3d02b0c36dc None admin] PATH_INFO: `/v3/roles/service` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:53.121360 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93159383-b270-41d9-97a2-f3d02b0c36dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:25:53.133665 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application [None req-93159383-b270-41d9-97a2-f3d02b0c36dc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 15:25:53.133665 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:25:53.133665 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:25:53.133665 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:25:53.133665 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:25:53.133665 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:25:53.133665 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:25:53.133665 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:25:53.133665 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:25:53.133665 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:25:53.133665 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:25:53.133665 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:25:53.133665 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:25:53.133665 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:25:53.133665 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:25:53.133665 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:25:53.135583 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:25:53.135583 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:25:53.135583 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:25:53.135583 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:25:53.135583 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:25:53.135583 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:25:53.135583 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:25:53.135583 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:25:53.135583 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:25:53.135583 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:25:53.135583 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:25:53.135583 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application with Lock( Jul 26 15:25:53.135583 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:25:53.135583 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:25:53.135583 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:25:53.135583 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:25:53.137864 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:25:53.137864 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:25:53.137864 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:25:53.137864 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:25:53.137864 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:25:53.137864 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:25:53.137864 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:25:53.137864 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:25:53.137864 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:25:53.137864 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:25:53.137864 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 15:25:53.137864 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:25:53.143854 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 293/584] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jul 26 15:25:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:25:53.148400 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93159383-b270-41d9-97a2-f3d02b0c36dc None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:53.200197 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dc7719-8bcf-4022-834b-98b61ed4c7b7 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:53.286733 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ac9af1-df44-4742-b242-7b6b7b661e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:53.287839 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac9af1-df44-4742-b242-7b6b7b661e02 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:53.288939 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac9af1-df44-4742-b242-7b6b7b661e02 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:53.289606 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac9af1-df44-4742-b242-7b6b7b661e02 None admin] PATH_INFO: `/v3/projects` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:53.291380 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ac9af1-df44-4742-b242-7b6b7b661e02 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:53.292015 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ac9af1-df44-4742-b242-7b6b7b661e02 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:53.296205 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ac9af1-df44-4742-b242-7b6b7b661e02 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:53.319847 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 292/585] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jul 26 15:25:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:53.321486 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93159383-b270-41d9-97a2-f3d02b0c36dc None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:53.327719 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:53.331007 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ac9af1-df44-4742-b242-7b6b7b661e02 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:53.354075 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:53.380326 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a2581e-0a07-4586-8aed-ef6b2a15d79f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:53.381007 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a2581e-0a07-4586-8aed-ef6b2a15d79f None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:53.381293 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a2581e-0a07-4586-8aed-ef6b2a15d79f None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:53.382278 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a2581e-0a07-4586-8aed-ef6b2a15d79f None admin] PATH_INFO: `/v3/roles` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:53.384264 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a2581e-0a07-4586-8aed-ef6b2a15d79f None admin] RBAC: Adding query filter params (name=service) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:53.384677 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a2581e-0a07-4586-8aed-ef6b2a15d79f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:53.386817 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a2581e-0a07-4586-8aed-ef6b2a15d79f None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:53.399254 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 294/586] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jul 26 15:25:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:53.406538 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a2581e-0a07-4586-8aed-ef6b2a15d79f None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:53.497165 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ac9af1-df44-4742-b242-7b6b7b661e02 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:53.539216 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0398d3d3-4d29-4597-ba4f-80e5e6533e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:53.539836 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0398d3d3-4d29-4597-ba4f-80e5e6533e62 None admin] REQUEST_METHOD: `PUT` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:53.540120 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0398d3d3-4d29-4597-ba4f-80e5e6533e62 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:53.540398 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0398d3d3-4d29-4597-ba4f-80e5e6533e62 None admin] PATH_INFO: `/v3/projects/9178e468facc41d6a7d828dfcd5301b4/users/279031fbf2114c11883018b0d41e243a/roles/2a6f012a2a004fbb8ab4d8a5f8633a22` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:53.559560 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0398d3d3-4d29-4597-ba4f-80e5e6533e62 None admin] RBAC: Authorizing `identity:create_grant(project_id=9178e468facc41d6a7d828dfcd5301b4, user_id=279031fbf2114c11883018b0d41e243a, role_id=2a6f012a2a004fbb8ab4d8a5f8633a22)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:53.561289 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0398d3d3-4d29-4597-ba4f-80e5e6533e62 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:53.597382 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a2581e-0a07-4586-8aed-ef6b2a15d79f None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:53.654356 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 293/587] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jul 26 15:25:53 2022] PUT /identity/v3/projects/9178e468facc41d6a7d828dfcd5301b4/users/279031fbf2114c11883018b0d41e243a/roles/2a6f012a2a004fbb8ab4d8a5f8633a22 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:25:53.660502 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e91230e-ed3c-4f1c-8a34-4b60552d744b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:53.661931 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e91230e-ed3c-4f1c-8a34-4b60552d744b None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:53.662564 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e91230e-ed3c-4f1c-8a34-4b60552d744b None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:53.663244 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e91230e-ed3c-4f1c-8a34-4b60552d744b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:53.687488 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e91230e-ed3c-4f1c-8a34-4b60552d744b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:53.690542 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e91230e-ed3c-4f1c-8a34-4b60552d744b None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:53.721845 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application [None req-3e91230e-ed3c-4f1c-8a34-4b60552d744b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:25:53.721845 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:25:53.721845 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:25:53.721845 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:25:53.721845 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:25:53.721845 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:25:53.721845 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:25:53.721845 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:25:53.721845 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:25:53.721845 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:25:53.721845 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:25:53.721845 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:25:53.721845 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:25:53.721845 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:25:53.721845 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:25:53.722836 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:25:53.722836 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:25:53.722836 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:25:53.722836 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:25:53.722836 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:25:53.722836 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:25:53.722836 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:25:53.722836 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:25:53.722836 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application with Lock( Jul 26 15:25:53.722836 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:25:53.722836 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:25:53.722836 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:25:53.722836 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:25:53.722836 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:25:53.722836 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:25:53.722836 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:25:53.722836 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:25:53.723794 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:25:53.723794 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:25:53.723794 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:25:53.723794 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:25:53.725828 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 295/588] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 15:25:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:25:53.730500 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0398d3d3-4d29-4597-ba4f-80e5e6533e62 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:53.830168 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:53.910696 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0398d3d3-4d29-4597-ba4f-80e5e6533e62 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:53.982717 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b50243e-42c1-4783-a841-0ae6c5907eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:53.983872 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b50243e-42c1-4783-a841-0ae6c5907eba None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:53.984361 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b50243e-42c1-4783-a841-0ae6c5907eba None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:53.984861 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b50243e-42c1-4783-a841-0ae6c5907eba None admin] PATH_INFO: `/v3/domains` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:53.986161 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b50243e-42c1-4783-a841-0ae6c5907eba None admin] RBAC: Adding query filter params (name=Default) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:53.986720 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b50243e-42c1-4783-a841-0ae6c5907eba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:53.989559 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b50243e-42c1-4783-a841-0ae6c5907eba None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:54.014362 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 294/589] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 15:25:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:54.022943 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e91230e-ed3c-4f1c-8a34-4b60552d744b None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:54.050017 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:54.180229 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e91230e-ed3c-4f1c-8a34-4b60552d744b None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:54.228132 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f300875b-38cd-45a3-9207-910895c8e1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:54.228817 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f300875b-38cd-45a3-9207-910895c8e1a0 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:54.229158 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f300875b-38cd-45a3-9207-910895c8e1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:54.229443 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f300875b-38cd-45a3-9207-910895c8e1a0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:54.239611 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f300875b-38cd-45a3-9207-910895c8e1a0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:54.241136 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f300875b-38cd-45a3-9207-910895c8e1a0 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:54.255762 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application [None req-f300875b-38cd-45a3-9207-910895c8e1a0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 15:25:54.255762 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:25:54.255762 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:25:54.255762 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:25:54.255762 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:25:54.255762 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:25:54.255762 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:25:54.255762 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:25:54.255762 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:25:54.255762 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:25:54.255762 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:25:54.255762 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:25:54.255762 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 15:25:54.255762 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 15:25:54.255762 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 15:25:54.255762 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 15:25:54.259299 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:25:54.259299 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:25:54.259299 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 15:25:54.259299 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:25:54.259299 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 15:25:54.259299 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:25:54.259299 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:25:54.259299 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:25:54.259299 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:25:54.259299 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:25:54.259299 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:25:54.259299 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application with Lock( Jul 26 15:25:54.259299 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:25:54.259299 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:25:54.259299 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:25:54.259299 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:25:54.259299 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:25:54.259299 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:25:54.267685 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:25:54.267685 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:25:54.267685 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 15:25:54.267685 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 15:25:54.267685 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 15:25:54.267685 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 15:25:54.267685 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 15:25:54.267685 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 15:25:54.267685 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 15:25:54.267685 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:25:54.267685 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 296/590] 10.222.0.18 () {56 vars in 1093 bytes} [Tue Jul 26 15:25:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:25:54.269126 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b50243e-42c1-4783-a841-0ae6c5907eba None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:54.441683 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b50243e-42c1-4783-a841-0ae6c5907eba None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:54.486824 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:54.507687 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ac5ce9-fb82-4c22-88d0-5738982240aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:54.508792 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac5ce9-fb82-4c22-88d0-5738982240aa None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:54.509320 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac5ce9-fb82-4c22-88d0-5738982240aa None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:54.509815 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac5ce9-fb82-4c22-88d0-5738982240aa None admin] PATH_INFO: `/v3/users` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:54.512034 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ac5ce9-fb82-4c22-88d0-5738982240aa None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:54.512604 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ac5ce9-fb82-4c22-88d0-5738982240aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:54.515341 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ac5ce9-fb82-4c22-88d0-5738982240aa None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:54.551390 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 295/591] 10.222.0.18 () {56 vars in 1133 bytes} [Tue Jul 26 15:25:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:54.560374 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f300875b-38cd-45a3-9207-910895c8e1a0 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:54.667035 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:54.703603 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f300875b-38cd-45a3-9207-910895c8e1a0 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:54.808219 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a78897-1857-47a9-bb7b-560221ce096b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:54.808940 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a78897-1857-47a9-bb7b-560221ce096b None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:54.809238 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a78897-1857-47a9-bb7b-560221ce096b None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:54.809515 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a78897-1857-47a9-bb7b-560221ce096b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:54.893435 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a78897-1857-47a9-bb7b-560221ce096b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:54.894918 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a78897-1857-47a9-bb7b-560221ce096b None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:54.991655 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:55.025655 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 297/592] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 15:25:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 15:25:55.036854 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ac5ce9-fb82-4c22-88d0-5738982240aa None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:55.039988 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be63842a-4098-47e0-a4d1-8787a3302cce None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:55.040648 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be63842a-4098-47e0-a4d1-8787a3302cce None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:55.041149 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be63842a-4098-47e0-a4d1-8787a3302cce None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:55.044087 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 298/593] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:25:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:25:55.050612 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57277516-b656-4140-9b45-b622450333f0 None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:55.051324 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57277516-b656-4140-9b45-b622450333f0 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:55.051810 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57277516-b656-4140-9b45-b622450333f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:55.074784 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-57277516-b656-4140-9b45-b622450333f0 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:25:55.076504 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-57277516-b656-4140-9b45-b622450333f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:25:55.166367 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 299/594] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:25:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:25:55.189156 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57277516-b656-4140-9b45-b622450333f0 None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:55.234401 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ac5ce9-fb82-4c22-88d0-5738982240aa None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:55.285493 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80464f9f-124b-44a2-a672-ecf6d3275d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:55.285493 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80464f9f-124b-44a2-a672-ecf6d3275d98 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:55.285493 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80464f9f-124b-44a2-a672-ecf6d3275d98 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:55.285493 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80464f9f-124b-44a2-a672-ecf6d3275d98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:55.299247 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80464f9f-124b-44a2-a672-ecf6d3275d98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:55.301113 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80464f9f-124b-44a2-a672-ecf6d3275d98 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:55.321047 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-80464f9f-124b-44a2-a672-ecf6d3275d98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:25:55.321047 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:25:55.321047 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:25:55.321047 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:25:55.321047 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:25:55.321047 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:25:55.321047 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:25:55.321047 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:25:55.321047 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:25:55.321047 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:25:55.321047 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:25:55.321047 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:25:55.321047 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:25:55.321047 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:25:55.321047 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:25:55.322007 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:25:55.322007 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:25:55.322007 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:25:55.322007 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:25:55.322007 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:25:55.322007 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:25:55.322007 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:25:55.322007 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:25:55.322007 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:25:55.322007 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:25:55.322007 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:25:55.322007 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:25:55.322007 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:25:55.322007 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:25:55.322007 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:25:55.322007 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:25:55.322007 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:25:55.322899 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:25:55.322899 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:25:55.322899 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:25:55.322899 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:25:55.325628 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 296/595] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 15:25:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:25:55.334948 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80464f9f-124b-44a2-a672-ecf6d3275d98 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:55.357031 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57277516-b656-4140-9b45-b622450333f0 None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:55.359553 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:55.404741 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93ced1e-baee-4a1a-aa4c-973fbdad2a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:55.405757 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ced1e-baee-4a1a-aa4c-973fbdad2a6d None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:55.406273 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ced1e-baee-4a1a-aa4c-973fbdad2a6d None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:55.406762 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ced1e-baee-4a1a-aa4c-973fbdad2a6d None admin] PATH_INFO: `/v3/roles/service` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:55.413859 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:55.419989 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93ced1e-baee-4a1a-aa4c-973fbdad2a6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:25:55.425493 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application [None req-e93ced1e-baee-4a1a-aa4c-973fbdad2a6d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 15:25:55.425493 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:25:55.425493 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:25:55.425493 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:25:55.425493 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:25:55.425493 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:25:55.425493 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:25:55.425493 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:25:55.425493 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:25:55.425493 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:25:55.425493 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:25:55.425493 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:25:55.425493 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:25:55.425493 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:25:55.425493 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:25:55.425493 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:25:55.426615 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:25:55.426615 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:25:55.426615 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:25:55.426615 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:25:55.426615 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:25:55.426615 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:25:55.426615 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:25:55.426615 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:25:55.426615 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:25:55.426615 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:25:55.426615 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:25:55.426615 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application with Lock( Jul 26 15:25:55.426615 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:25:55.426615 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:25:55.426615 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:25:55.426615 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:25:55.427498 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:25:55.427498 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:25:55.427498 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:25:55.427498 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:25:55.427498 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:25:55.427498 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:25:55.427498 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:25:55.427498 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:25:55.427498 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:25:55.427498 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:25:55.427498 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 15:25:55.427498 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:25:55.430007 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 300/596] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jul 26 15:25:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 15:25:55.439084 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93ced1e-baee-4a1a-aa4c-973fbdad2a6d None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:55.509666 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80464f9f-124b-44a2-a672-ecf6d3275d98 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:55.550585 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aa94ab-66ab-4092-93b6-24b054e0b262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:55.551024 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa94ab-66ab-4092-93b6-24b054e0b262 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:55.551365 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa94ab-66ab-4092-93b6-24b054e0b262 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:55.551643 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa94ab-66ab-4092-93b6-24b054e0b262 None admin] PATH_INFO: `/v3/domains` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:55.552350 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aa94ab-66ab-4092-93b6-24b054e0b262 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:55.552652 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aa94ab-66ab-4092-93b6-24b054e0b262 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:55.554215 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aa94ab-66ab-4092-93b6-24b054e0b262 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:55.575160 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 297/597] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 15:25:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:55.580016 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aa94ab-66ab-4092-93b6-24b054e0b262 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:55.626434 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93ced1e-baee-4a1a-aa4c-973fbdad2a6d None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:55.673605 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c861dc09-b7ac-4faa-b396-ea6fb437a886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:55.674437 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c861dc09-b7ac-4faa-b396-ea6fb437a886 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:55.674820 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c861dc09-b7ac-4faa-b396-ea6fb437a886 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:55.675244 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c861dc09-b7ac-4faa-b396-ea6fb437a886 None admin] PATH_INFO: `/v3/roles` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:55.676122 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c861dc09-b7ac-4faa-b396-ea6fb437a886 None admin] RBAC: Adding query filter params (name=service) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:55.676531 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c861dc09-b7ac-4faa-b396-ea6fb437a886 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:55.678100 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c861dc09-b7ac-4faa-b396-ea6fb437a886 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:55.695235 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 301/598] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jul 26 15:25:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:55.697714 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c861dc09-b7ac-4faa-b396-ea6fb437a886 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:55.735314 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:55.801576 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:55.812774 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aa94ab-66ab-4092-93b6-24b054e0b262 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:55.857308 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe64a0f-eb70-4141-a489-e4916c5aacf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:55.858420 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe64a0f-eb70-4141-a489-e4916c5aacf4 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:55.858878 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe64a0f-eb70-4141-a489-e4916c5aacf4 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:55.859360 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe64a0f-eb70-4141-a489-e4916c5aacf4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:55.867804 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe64a0f-eb70-4141-a489-e4916c5aacf4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:55.869595 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe64a0f-eb70-4141-a489-e4916c5aacf4 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:55.883574 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-ebe64a0f-eb70-4141-a489-e4916c5aacf4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:25:55.883574 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:25:55.883574 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:25:55.883574 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:25:55.883574 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:25:55.883574 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:25:55.883574 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:25:55.883574 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:25:55.883574 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:25:55.883574 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:25:55.883574 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:25:55.883574 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:25:55.883574 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 15:25:55.883574 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 15:25:55.883574 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 15:25:55.884523 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 15:25:55.884523 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:25:55.884523 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:25:55.884523 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:25:55.884523 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:25:55.884523 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:25:55.884523 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:25:55.884523 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:25:55.884523 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:25:55.884523 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:25:55.884523 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:25:55.884523 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:25:55.884523 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:25:55.884523 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:25:55.884523 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:25:55.884523 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:25:55.884523 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:25:55.885414 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 15:25:55.885414 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 15:25:55.885414 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 15:25:55.885414 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 15:25:55.885414 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 15:25:55.885414 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 15:25:55.885414 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:25:55.885414 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:25:55.888940 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 298/599] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 15:25:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:25:55.898865 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe64a0f-eb70-4141-a489-e4916c5aacf4 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:55.903359 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c861dc09-b7ac-4faa-b396-ea6fb437a886 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:55.950267 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0167b63b-8bd4-444a-b64e-5d525ac8bede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:55.950926 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0167b63b-8bd4-444a-b64e-5d525ac8bede None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:55.951239 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0167b63b-8bd4-444a-b64e-5d525ac8bede None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:55.951517 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0167b63b-8bd4-444a-b64e-5d525ac8bede None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:55.962904 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0167b63b-8bd4-444a-b64e-5d525ac8bede None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:55.964952 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0167b63b-8bd4-444a-b64e-5d525ac8bede None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:55.980829 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application [None req-0167b63b-8bd4-444a-b64e-5d525ac8bede None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:25:55.980829 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:25:55.980829 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:25:55.980829 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:25:55.980829 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:25:55.980829 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:25:55.980829 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:25:55.980829 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:25:55.980829 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:25:55.980829 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:25:55.980829 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:25:55.980829 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:25:55.980829 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:25:55.980829 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:25:55.980829 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:25:55.982638 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:25:55.982638 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:25:55.982638 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:25:55.982638 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:25:55.982638 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:25:55.982638 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:25:55.982638 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:25:55.982638 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:25:55.982638 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application with Lock( Jul 26 15:25:55.982638 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:25:55.982638 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:25:55.982638 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:25:55.982638 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:25:55.982638 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:25:55.982638 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:25:55.982638 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:25:55.982638 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:25:55.984562 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:25:55.984562 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:25:55.984562 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:25:55.984562 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:25:55.990981 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 302/600] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 15:25:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:25:55.990981 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa3e9a-8760-4801-92f9-2d58a191f8e2 None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:55.990981 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa3e9a-8760-4801-92f9-2d58a191f8e2 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:55.990981 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa3e9a-8760-4801-92f9-2d58a191f8e2 None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:55.990981 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 303/601] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:25:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:25:55.992402 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aa3e9a-8760-4801-92f9-2d58a191f8e2 None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:56.081952 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe64a0f-eb70-4141-a489-e4916c5aacf4 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:56.118246 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:56.140146 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b05b7d-28a9-4b91-b5eb-7a167c4b5c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:56.140775 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b05b7d-28a9-4b91-b5eb-7a167c4b5c9f None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:56.141058 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b05b7d-28a9-4b91-b5eb-7a167c4b5c9f None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:56.141338 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b05b7d-28a9-4b91-b5eb-7a167c4b5c9f None admin] PATH_INFO: `/v3/projects` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:56.142099 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b05b7d-28a9-4b91-b5eb-7a167c4b5c9f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:56.142406 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b05b7d-28a9-4b91-b5eb-7a167c4b5c9f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:56.143936 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b05b7d-28a9-4b91-b5eb-7a167c4b5c9f None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:56.164486 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 299/602] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jul 26 15:25:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:56.164486 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da9755-9f6d-4083-bb30-db7c3272989e None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:56.164486 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da9755-9f6d-4083-bb30-db7c3272989e None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:56.164486 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da9755-9f6d-4083-bb30-db7c3272989e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:56.166448 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aa3e9a-8760-4801-92f9-2d58a191f8e2 None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:56.186352 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-a8da9755-9f6d-4083-bb30-db7c3272989e None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:25:56.187999 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-a8da9755-9f6d-4083-bb30-db7c3272989e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:25:56.201578 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:56.229265 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8da208-bb22-4763-b142-a64ccb942bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:56.230702 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8da208-bb22-4763-b142-a64ccb942bb6 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:56.230988 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8da208-bb22-4763-b142-a64ccb942bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:56.231311 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8da208-bb22-4763-b142-a64ccb942bb6 None admin] PATH_INFO: `/v3/domains` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:56.232058 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8da208-bb22-4763-b142-a64ccb942bb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:56.232364 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8da208-bb22-4763-b142-a64ccb942bb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:56.233838 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8da208-bb22-4763-b142-a64ccb942bb6 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:56.250479 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 304/603] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 15:25:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:56.251298 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8da208-bb22-4763-b142-a64ccb942bb6 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:56.303223 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 300/604] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:25:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:25:56.303790 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8da9755-9f6d-4083-bb30-db7c3272989e None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:56.425989 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8da208-bb22-4763-b142-a64ccb942bb6 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:56.463208 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8da9755-9f6d-4083-bb30-db7c3272989e None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:56.469945 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b5d8c4-cdf5-43cf-8ea3-f189f4d9079c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:56.470574 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b5d8c4-cdf5-43cf-8ea3-f189f4d9079c None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:56.470863 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b5d8c4-cdf5-43cf-8ea3-f189f4d9079c None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:56.471146 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b5d8c4-cdf5-43cf-8ea3-f189f4d9079c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:56.471973 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b5d8c4-cdf5-43cf-8ea3-f189f4d9079c None admin] RBAC: Adding query filter params (role.id=2a6f012a2a004fbb8ab4d8a5f8633a22, scope.project.id=9178e468facc41d6a7d828dfcd5301b4, user.id=fbc5f2b36d3f45f1b3c8155e46c46fda) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:56.472285 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b5d8c4-cdf5-43cf-8ea3-f189f4d9079c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:56.473741 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b5d8c4-cdf5-43cf-8ea3-f189f4d9079c None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:56.476909 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:56.480526 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 305/605] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 26 15:25:56 2022] GET /identity/v3/role_assignments?user.id=fbc5f2b36d3f45f1b3c8155e46c46fda&scope.project.id=9178e468facc41d6a7d828dfcd5301b4&role.id=2a6f012a2a004fbb8ab4d8a5f8633a22 => generated 608 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:56.481521 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b5d8c4-cdf5-43cf-8ea3-f189f4d9079c None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:56.518212 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ef04b6-ee8a-4001-84eb-7a3fb698e70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:56.519389 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef04b6-ee8a-4001-84eb-7a3fb698e70e None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:56.519899 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef04b6-ee8a-4001-84eb-7a3fb698e70e None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:56.520390 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef04b6-ee8a-4001-84eb-7a3fb698e70e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:56.534204 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ef04b6-ee8a-4001-84eb-7a3fb698e70e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:56.537159 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ef04b6-ee8a-4001-84eb-7a3fb698e70e None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:56.561831 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-e0ef04b6-ee8a-4001-84eb-7a3fb698e70e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 26 15:25:56.561831 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:25:56.561831 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:25:56.561831 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:25:56.561831 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:25:56.561831 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:25:56.561831 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:25:56.561831 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:25:56.561831 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:25:56.561831 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:25:56.561831 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:25:56.561831 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:25:56.561831 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 15:25:56.561831 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 15:25:56.561831 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 15:25:56.561831 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 15:25:56.563211 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:25:56.563211 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:25:56.563211 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 15:25:56.563211 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:25:56.563211 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 15:25:56.563211 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:25:56.563211 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:25:56.563211 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:25:56.563211 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:25:56.563211 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:25:56.563211 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:25:56.563211 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:25:56.563211 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:25:56.563211 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:25:56.563211 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:25:56.563211 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:25:56.563211 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:25:56.563211 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:25:56.564375 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:25:56.564375 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:25:56.564375 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 15:25:56.564375 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 15:25:56.564375 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 15:25:56.564375 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 15:25:56.564375 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 15:25:56.564375 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 15:25:56.564375 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 26 15:25:56.564375 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:25:56.564375 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 301/606] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jul 26 15:25:56 2022] GET /identity/v3/users/neutron => generated 85 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:25:56.566238 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3589647b-c914-4ec0-bd68-f82e80d1db74 None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:56.566699 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3589647b-c914-4ec0-bd68-f82e80d1db74 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:56.567350 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3589647b-c914-4ec0-bd68-f82e80d1db74 None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:56.569988 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 302/607] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:25:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:25:56.576198 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3589647b-c914-4ec0-bd68-f82e80d1db74 None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:56.579459 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:56.653341 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b5d8c4-cdf5-43cf-8ea3-f189f4d9079c None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:56.709182 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28353882-ce47-41a7-819c-0cb210db624e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:56.709930 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28353882-ce47-41a7-819c-0cb210db624e None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:56.710279 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28353882-ce47-41a7-819c-0cb210db624e None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:56.710620 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28353882-ce47-41a7-819c-0cb210db624e None admin] PATH_INFO: `/v3/roles/service` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:56.727117 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28353882-ce47-41a7-819c-0cb210db624e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:25:56.737192 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application [None req-28353882-ce47-41a7-819c-0cb210db624e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 15:25:56.737192 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:25:56.737192 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:25:56.737192 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:25:56.737192 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:25:56.737192 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:25:56.737192 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:25:56.737192 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:25:56.737192 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:25:56.737192 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:25:56.737192 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:25:56.737192 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:25:56.737192 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:25:56.737192 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:25:56.737192 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:25:56.737192 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:25:56.739171 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:25:56.739171 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:25:56.739171 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:25:56.739171 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:25:56.739171 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:25:56.739171 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:25:56.739171 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:25:56.739171 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:25:56.739171 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:25:56.739171 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:25:56.739171 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:25:56.739171 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application with Lock( Jul 26 15:25:56.739171 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:25:56.739171 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:25:56.739171 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:25:56.739171 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:25:56.740942 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:25:56.740942 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:25:56.740942 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:25:56.740942 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:25:56.740942 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:25:56.740942 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:25:56.740942 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:25:56.740942 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:25:56.740942 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:25:56.740942 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:25:56.740942 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 15:25:56.740942 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:25:56.747391 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 306/608] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jul 26 15:25:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:25:56.749148 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede36480-65ea-47d4-a931-199f4c270b00 None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:56.749414 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3589647b-c914-4ec0-bd68-f82e80d1db74 None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:56.749520 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede36480-65ea-47d4-a931-199f4c270b00 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:56.749724 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede36480-65ea-47d4-a931-199f4c270b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:56.770509 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-ede36480-65ea-47d4-a931-199f4c270b00 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:25:56.771767 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-ede36480-65ea-47d4-a931-199f4c270b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:25:56.808883 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed126d8-0785-49af-ab21-7a467de6856b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:56.809525 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed126d8-0785-49af-ab21-7a467de6856b None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:56.809807 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed126d8-0785-49af-ab21-7a467de6856b None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:56.810085 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed126d8-0785-49af-ab21-7a467de6856b None admin] PATH_INFO: `/v3/users` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:56.810970 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed126d8-0785-49af-ab21-7a467de6856b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:56.811337 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed126d8-0785-49af-ab21-7a467de6856b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:56.812835 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed126d8-0785-49af-ab21-7a467de6856b None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:56.834121 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 303/609] 10.222.0.18 () {56 vars in 1139 bytes} [Tue Jul 26 15:25:56 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:56.834822 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed126d8-0785-49af-ab21-7a467de6856b None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:56.842011 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:56.856713 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 307/610] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:25:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:25:56.857616 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede36480-65ea-47d4-a931-199f4c270b00 None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:56.924906 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:56.980436 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed126d8-0785-49af-ab21-7a467de6856b None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:56.997454 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede36480-65ea-47d4-a931-199f4c270b00 None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:57.033927 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f1d145-9cd6-4e4d-95d2-b0c58ae8878b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:57.035297 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f1d145-9cd6-4e4d-95d2-b0c58ae8878b None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:57.035796 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f1d145-9cd6-4e4d-95d2-b0c58ae8878b None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:57.036289 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f1d145-9cd6-4e4d-95d2-b0c58ae8878b None admin] PATH_INFO: `/v3/roles` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:57.037569 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f1d145-9cd6-4e4d-95d2-b0c58ae8878b None admin] RBAC: Adding query filter params (name=service) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:57.038116 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f1d145-9cd6-4e4d-95d2-b0c58ae8878b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:57.040753 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f1d145-9cd6-4e4d-95d2-b0c58ae8878b None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:57.049558 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca26e08d-0f57-4728-989e-65df6570c4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:57.050599 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca26e08d-0f57-4728-989e-65df6570c4a4 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:57.050890 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca26e08d-0f57-4728-989e-65df6570c4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:57.051200 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca26e08d-0f57-4728-989e-65df6570c4a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:57.058970 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 304/611] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jul 26 15:25:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:57.058970 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f1d145-9cd6-4e4d-95d2-b0c58ae8878b None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:57.123091 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:57.134198 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca26e08d-0f57-4728-989e-65df6570c4a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:57.135694 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca26e08d-0f57-4728-989e-65df6570c4a4 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:57.215881 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f1d145-9cd6-4e4d-95d2-b0c58ae8878b None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:57.248810 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:57.258651 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 308/612] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 15:25:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 15:25:57.259469 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca26e08d-0f57-4728-989e-65df6570c4a4 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:57.270344 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6567ec-0967-4c4a-b0b0-8d12390c6d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:57.271023 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6567ec-0967-4c4a-b0b0-8d12390c6d18 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:57.271361 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6567ec-0967-4c4a-b0b0-8d12390c6d18 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:57.271646 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6567ec-0967-4c4a-b0b0-8d12390c6d18 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:57.289856 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6567ec-0967-4c4a-b0b0-8d12390c6d18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:25:57.295798 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-2c6567ec-0967-4c4a-b0b0-8d12390c6d18 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 15:25:57.295798 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:25:57.295798 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:25:57.295798 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:25:57.295798 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:25:57.295798 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:25:57.295798 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:25:57.295798 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:25:57.295798 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:25:57.295798 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:25:57.295798 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:25:57.295798 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:25:57.295798 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:25:57.295798 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:25:57.295798 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:25:57.295798 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:25:57.296810 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:25:57.296810 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:25:57.296810 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:25:57.296810 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:25:57.296810 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:25:57.296810 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:25:57.296810 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:25:57.296810 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:25:57.296810 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:25:57.296810 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:25:57.296810 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:25:57.296810 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:25:57.296810 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:25:57.296810 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:25:57.296810 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:25:57.296810 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:25:57.297652 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:25:57.297652 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:25:57.297652 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:25:57.297652 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:25:57.297652 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:25:57.297652 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:25:57.297652 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:25:57.297652 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:25:57.297652 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:25:57.297652 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:25:57.297652 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 15:25:57.297652 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:25:57.297652 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 305/613] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jul 26 15:25:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:25:57.298341 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6567ec-0967-4c4a-b0b0-8d12390c6d18 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:57.416484 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:57.428842 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca26e08d-0f57-4728-989e-65df6570c4a4 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:57.446741 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6567ec-0967-4c4a-b0b0-8d12390c6d18 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:57.485994 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b8821f-d431-49d9-aab0-9103146faeba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:57.486520 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48628050-0ec6-4073-b1f3-7600173d96c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:57.486734 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8821f-d431-49d9-aab0-9103146faeba None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:57.487003 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8821f-d431-49d9-aab0-9103146faeba None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:57.487261 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8821f-d431-49d9-aab0-9103146faeba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:57.487539 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48628050-0ec6-4073-b1f3-7600173d96c9 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:57.488273 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48628050-0ec6-4073-b1f3-7600173d96c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:57.488764 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48628050-0ec6-4073-b1f3-7600173d96c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:57.500834 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b8821f-d431-49d9-aab0-9103146faeba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:57.502252 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b8821f-d431-49d9-aab0-9103146faeba None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:57.509044 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48628050-0ec6-4073-b1f3-7600173d96c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:57.510534 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48628050-0ec6-4073-b1f3-7600173d96c9 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:57.524108 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-20b8821f-d431-49d9-aab0-9103146faeba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:25:57.524108 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:25:57.524108 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:25:57.524108 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:25:57.524108 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:25:57.524108 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:25:57.524108 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:25:57.524108 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:25:57.524108 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:25:57.524108 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:25:57.524108 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:25:57.524108 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:25:57.524108 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:25:57.524108 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:25:57.524108 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:25:57.525917 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:25:57.525917 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:25:57.525917 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:25:57.525917 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:25:57.525917 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:25:57.525917 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:25:57.525917 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:25:57.525917 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:25:57.525917 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:25:57.525917 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:25:57.525917 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:25:57.525917 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:25:57.525917 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:25:57.525917 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:25:57.525917 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:25:57.525917 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:25:57.525917 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:25:57.538323 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:25:57.538323 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:25:57.538323 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:25:57.538323 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:25:57.538323 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 306/614] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 15:25:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:25:57.538323 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b8821f-d431-49d9-aab0-9103146faeba None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:57.540631 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application [None req-48628050-0ec6-4073-b1f3-7600173d96c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:25:57.540631 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:25:57.540631 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:25:57.540631 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:25:57.540631 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:25:57.540631 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:25:57.540631 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:25:57.540631 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:25:57.540631 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:25:57.540631 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:25:57.540631 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:25:57.540631 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:25:57.540631 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:25:57.540631 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:25:57.540631 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:25:57.545280 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:25:57.545280 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:25:57.545280 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:25:57.545280 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:25:57.545280 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:25:57.545280 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:25:57.545280 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:25:57.545280 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:25:57.545280 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application with Lock( Jul 26 15:25:57.545280 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:25:57.545280 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:25:57.545280 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:25:57.545280 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:25:57.545280 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:25:57.545280 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:25:57.545280 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:25:57.545280 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:25:57.547576 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:25:57.547576 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:25:57.547576 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:25:57.547576 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:25:57.547576 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 309/615] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 15:25:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:25:57.547576 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48628050-0ec6-4073-b1f3-7600173d96c9 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:57.588885 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:57.689420 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b8821f-d431-49d9-aab0-9103146faeba None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:57.694587 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48628050-0ec6-4073-b1f3-7600173d96c9 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:57.740433 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e005aa0-3457-474e-be1e-4c868021a894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:57.741054 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd45a45f-be1c-4807-8bdd-cff84a0681b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:57.741474 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e005aa0-3457-474e-be1e-4c868021a894 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:57.741757 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd45a45f-be1c-4807-8bdd-cff84a0681b6 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:57.741917 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e005aa0-3457-474e-be1e-4c868021a894 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:57.742058 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd45a45f-be1c-4807-8bdd-cff84a0681b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:57.742361 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd45a45f-be1c-4807-8bdd-cff84a0681b6 None admin] PATH_INFO: `/v3/roles` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:57.742518 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e005aa0-3457-474e-be1e-4c868021a894 None admin] PATH_INFO: `/v3/domains` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:57.742968 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd45a45f-be1c-4807-8bdd-cff84a0681b6 None admin] RBAC: Adding query filter params (name=service) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:57.743306 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd45a45f-be1c-4807-8bdd-cff84a0681b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:57.743595 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e005aa0-3457-474e-be1e-4c868021a894 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:57.744108 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e005aa0-3457-474e-be1e-4c868021a894 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:57.744742 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd45a45f-be1c-4807-8bdd-cff84a0681b6 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:57.747259 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e005aa0-3457-474e-be1e-4c868021a894 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:57.757910 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 307/616] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jul 26 15:25:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:57.761757 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd45a45f-be1c-4807-8bdd-cff84a0681b6 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:57.771199 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 310/617] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 15:25:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:57.773001 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e005aa0-3457-474e-be1e-4c868021a894 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:57.782376 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:57.891637 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:57.903622 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd45a45f-be1c-4807-8bdd-cff84a0681b6 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:57.935056 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e005aa0-3457-474e-be1e-4c868021a894 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:57.961271 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9008489-6e59-4657-904e-c579d0da4b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:57.961902 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9008489-6e59-4657-904e-c579d0da4b9c None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:57.962188 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9008489-6e59-4657-904e-c579d0da4b9c None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:57.962473 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9008489-6e59-4657-904e-c579d0da4b9c None admin] PATH_INFO: `/v3/domains` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:57.963237 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9008489-6e59-4657-904e-c579d0da4b9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:57.963548 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9008489-6e59-4657-904e-c579d0da4b9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:57.965054 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9008489-6e59-4657-904e-c579d0da4b9c None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:57.979178 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 308/618] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 15:25:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:57.980536 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9008489-6e59-4657-904e-c579d0da4b9c None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:58.004643 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34314bc6-7238-4e0d-83f1-72ffc4f41e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:58.005345 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34314bc6-7238-4e0d-83f1-72ffc4f41e19 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:58.005630 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34314bc6-7238-4e0d-83f1-72ffc4f41e19 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:58.005905 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34314bc6-7238-4e0d-83f1-72ffc4f41e19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:58.024010 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34314bc6-7238-4e0d-83f1-72ffc4f41e19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:58.026334 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34314bc6-7238-4e0d-83f1-72ffc4f41e19 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:58.058622 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application [None req-34314bc6-7238-4e0d-83f1-72ffc4f41e19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:25:58.058622 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:25:58.058622 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:25:58.058622 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:25:58.058622 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:25:58.058622 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:25:58.058622 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:25:58.058622 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:25:58.058622 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:25:58.058622 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:25:58.058622 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:25:58.058622 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:25:58.058622 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:25:58.058622 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:25:58.058622 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:25:58.060433 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:25:58.060433 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:25:58.060433 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:25:58.060433 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:25:58.060433 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:25:58.060433 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:25:58.060433 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:25:58.060433 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:25:58.060433 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application with Lock( Jul 26 15:25:58.060433 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:25:58.060433 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:25:58.060433 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:25:58.060433 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:25:58.060433 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:25:58.060433 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:25:58.060433 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:25:58.060433 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:25:58.062464 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:25:58.062464 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:25:58.062464 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:25:58.062464 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:25:58.062464 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 311/619] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 15:25:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:25:58.062464 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34314bc6-7238-4e0d-83f1-72ffc4f41e19 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:58.130141 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:58.130768 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9008489-6e59-4657-904e-c579d0da4b9c None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:58.179050 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669dabdb-0877-4505-9a58-566e14d2fc62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:58.179741 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669dabdb-0877-4505-9a58-566e14d2fc62 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:58.180030 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669dabdb-0877-4505-9a58-566e14d2fc62 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:58.180339 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669dabdb-0877-4505-9a58-566e14d2fc62 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:58.189895 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669dabdb-0877-4505-9a58-566e14d2fc62 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:58.191598 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669dabdb-0877-4505-9a58-566e14d2fc62 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:58.200492 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34314bc6-7238-4e0d-83f1-72ffc4f41e19 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:58.204558 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-669dabdb-0877-4505-9a58-566e14d2fc62 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 26 15:25:58.204558 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:25:58.204558 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:25:58.204558 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:25:58.204558 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:25:58.204558 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:25:58.204558 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:25:58.204558 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:25:58.204558 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:25:58.204558 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:25:58.204558 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:25:58.204558 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:25:58.204558 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 15:25:58.204558 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 15:25:58.204558 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 15:25:58.204558 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 15:25:58.205671 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:25:58.205671 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:25:58.205671 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 15:25:58.205671 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:25:58.205671 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 15:25:58.205671 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:25:58.205671 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:25:58.205671 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:25:58.205671 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:25:58.205671 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:25:58.205671 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:25:58.205671 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:25:58.205671 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:25:58.205671 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:25:58.205671 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:25:58.205671 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:25:58.205671 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:25:58.205671 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:25:58.207788 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:25:58.207788 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:25:58.207788 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 15:25:58.207788 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 15:25:58.207788 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 15:25:58.207788 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 15:25:58.207788 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 15:25:58.207788 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 15:25:58.207788 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 26 15:25:58.207788 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:25:58.207788 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 309/620] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 15:25:57 2022] GET /identity/v3/users/glance => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:25:58.207788 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669dabdb-0877-4505-9a58-566e14d2fc62 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:58.227720 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:58.243929 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde0fab5-f3a6-44eb-a494-666ef81e795a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:58.244595 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde0fab5-f3a6-44eb-a494-666ef81e795a None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:58.244864 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde0fab5-f3a6-44eb-a494-666ef81e795a None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:58.245139 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde0fab5-f3a6-44eb-a494-666ef81e795a None admin] PATH_INFO: `/v3/projects/service` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:58.253657 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde0fab5-f3a6-44eb-a494-666ef81e795a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:58.255175 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde0fab5-f3a6-44eb-a494-666ef81e795a None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:58.275765 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application [None req-cde0fab5-f3a6-44eb-a494-666ef81e795a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:25:58.275765 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:25:58.275765 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:25:58.275765 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:25:58.275765 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:25:58.275765 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:25:58.275765 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:25:58.275765 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:25:58.275765 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:25:58.275765 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:25:58.275765 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:25:58.275765 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:25:58.275765 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 15:25:58.275765 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 15:25:58.275765 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 15:25:58.277240 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 15:25:58.277240 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:25:58.277240 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:25:58.277240 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:25:58.277240 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:25:58.277240 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:25:58.277240 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:25:58.277240 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:25:58.277240 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application with Lock( Jul 26 15:25:58.277240 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:25:58.277240 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:25:58.277240 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:25:58.277240 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:25:58.277240 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:25:58.277240 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:25:58.277240 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:25:58.277240 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:25:58.278115 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 15:25:58.278115 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 15:25:58.278115 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 15:25:58.278115 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 15:25:58.278115 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 15:25:58.278115 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 15:25:58.278115 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:25:58.278115 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:25:58.278546 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 312/621] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 15:25:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:25:58.279849 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde0fab5-f3a6-44eb-a494-666ef81e795a None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:58.339694 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669dabdb-0877-4505-9a58-566e14d2fc62 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:58.385742 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b94be5-bf9d-4b9d-812b-c345b01619f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:58.387763 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b94be5-bf9d-4b9d-812b-c345b01619f6 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:58.388359 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b94be5-bf9d-4b9d-812b-c345b01619f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:58.388947 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b94be5-bf9d-4b9d-812b-c345b01619f6 None admin] PATH_INFO: `/v3/domains` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:58.390355 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b94be5-bf9d-4b9d-812b-c345b01619f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:58.391251 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b94be5-bf9d-4b9d-812b-c345b01619f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:58.393644 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b94be5-bf9d-4b9d-812b-c345b01619f6 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:58.421725 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 310/622] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 15:25:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:58.421725 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b94be5-bf9d-4b9d-812b-c345b01619f6 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:58.448287 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde0fab5-f3a6-44eb-a494-666ef81e795a None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:58.465612 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:58.494542 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013ae5ba-ef2a-4b85-81a4-2b5b4c6bc67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:58.496017 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013ae5ba-ef2a-4b85-81a4-2b5b4c6bc67d None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:58.496314 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013ae5ba-ef2a-4b85-81a4-2b5b4c6bc67d None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:58.497565 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013ae5ba-ef2a-4b85-81a4-2b5b4c6bc67d None admin] PATH_INFO: `/v3/users` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:58.499212 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013ae5ba-ef2a-4b85-81a4-2b5b4c6bc67d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:58.500328 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013ae5ba-ef2a-4b85-81a4-2b5b4c6bc67d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:58.502635 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013ae5ba-ef2a-4b85-81a4-2b5b4c6bc67d None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:58.539260 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 313/623] 10.222.0.18 () {56 vars in 1137 bytes} [Tue Jul 26 15:25:58 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:58.539260 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013ae5ba-ef2a-4b85-81a4-2b5b4c6bc67d None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:58.542995 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:58.572760 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b94be5-bf9d-4b9d-812b-c345b01619f6 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:58.627153 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda7268a-59c0-426a-8422-4aa9f28327a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:58.627780 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda7268a-59c0-426a-8422-4aa9f28327a8 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:58.628051 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda7268a-59c0-426a-8422-4aa9f28327a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:58.628327 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda7268a-59c0-426a-8422-4aa9f28327a8 None admin] PATH_INFO: `/v3/projects` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:58.629089 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda7268a-59c0-426a-8422-4aa9f28327a8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:58.629396 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda7268a-59c0-426a-8422-4aa9f28327a8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:58.630872 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda7268a-59c0-426a-8422-4aa9f28327a8 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:58.647302 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 311/624] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jul 26 15:25:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:58.648417 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda7268a-59c0-426a-8422-4aa9f28327a8 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:58.676684 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013ae5ba-ef2a-4b85-81a4-2b5b4c6bc67d None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:58.733177 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a142da52-bab1-4902-9a61-4592d0458741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:58.733827 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a142da52-bab1-4902-9a61-4592d0458741 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:58.734147 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a142da52-bab1-4902-9a61-4592d0458741 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:58.734414 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a142da52-bab1-4902-9a61-4592d0458741 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:58.743473 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a142da52-bab1-4902-9a61-4592d0458741 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:58.745920 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a142da52-bab1-4902-9a61-4592d0458741 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:58.761501 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application [None req-a142da52-bab1-4902-9a61-4592d0458741 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 15:25:58.761501 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:25:58.761501 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:25:58.761501 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:25:58.761501 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:25:58.761501 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:25:58.761501 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:25:58.761501 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:25:58.761501 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:25:58.761501 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:25:58.761501 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:25:58.761501 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:25:58.761501 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 15:25:58.761501 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 15:25:58.761501 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 15:25:58.761501 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 15:25:58.762545 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:25:58.762545 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:25:58.762545 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 15:25:58.762545 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:25:58.762545 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 15:25:58.762545 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:25:58.762545 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:25:58.762545 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:25:58.762545 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:25:58.762545 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:25:58.762545 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:25:58.762545 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application with Lock( Jul 26 15:25:58.762545 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:25:58.762545 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:25:58.762545 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:25:58.762545 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:25:58.762545 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:25:58.762545 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:25:58.764994 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:25:58.764994 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:25:58.764994 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 15:25:58.764994 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 15:25:58.764994 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 15:25:58.764994 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 15:25:58.764994 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 15:25:58.764994 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 15:25:58.764994 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 15:25:58.764994 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:25:58.764994 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 314/625] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 15:25:58 2022] GET /identity/v3/users/cinder => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:25:58.768057 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a142da52-bab1-4902-9a61-4592d0458741 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:58.807242 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda7268a-59c0-426a-8422-4aa9f28327a8 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:58.810547 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:58.861108 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64229b90-5e3f-4dbd-9e1e-622cb67f7b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:58.861880 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64229b90-5e3f-4dbd-9e1e-622cb67f7b59 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:58.862185 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64229b90-5e3f-4dbd-9e1e-622cb67f7b59 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:58.862448 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64229b90-5e3f-4dbd-9e1e-622cb67f7b59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:58.869193 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:58.925064 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a142da52-bab1-4902-9a61-4592d0458741 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:58.962313 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64229b90-5e3f-4dbd-9e1e-622cb67f7b59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:58.964683 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64229b90-5e3f-4dbd-9e1e-622cb67f7b59 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:58.971618 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b3e6ca-1e15-4e69-88b9-97916fd5b7e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:58.972240 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b3e6ca-1e15-4e69-88b9-97916fd5b7e3 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:58.972520 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b3e6ca-1e15-4e69-88b9-97916fd5b7e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:58.972798 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b3e6ca-1e15-4e69-88b9-97916fd5b7e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:58.973600 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b3e6ca-1e15-4e69-88b9-97916fd5b7e3 None admin] RBAC: Adding query filter params (role.id=2a6f012a2a004fbb8ab4d8a5f8633a22, scope.project.id=9178e468facc41d6a7d828dfcd5301b4, user.id=960c230d1e8841e6b231fdbf4d172cc6) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:58.973909 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b3e6ca-1e15-4e69-88b9-97916fd5b7e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:58.975386 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b3e6ca-1e15-4e69-88b9-97916fd5b7e3 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:58.982251 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 315/626] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 26 15:25:58 2022] GET /identity/v3/role_assignments?user.id=960c230d1e8841e6b231fdbf4d172cc6&scope.project.id=9178e468facc41d6a7d828dfcd5301b4&role.id=2a6f012a2a004fbb8ab4d8a5f8633a22 => generated 608 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:58.983097 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b3e6ca-1e15-4e69-88b9-97916fd5b7e3 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:59.121924 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 312/627] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 15:25:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 15:25:59.124399 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29751b28-d563-409b-ac3f-b2ca49f15cf7 None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:59.124987 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29751b28-d563-409b-ac3f-b2ca49f15cf7 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:59.125391 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29751b28-d563-409b-ac3f-b2ca49f15cf7 None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:59.127027 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 313/628] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:25:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:25:59.134660 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29751b28-d563-409b-ac3f-b2ca49f15cf7 None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:59.148265 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:59.156597 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b3e6ca-1e15-4e69-88b9-97916fd5b7e3 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:59.202937 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:59.217228 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3735068-b475-4a9a-b335-6edfc3013781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:59.217985 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3735068-b475-4a9a-b335-6edfc3013781 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:59.218273 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3735068-b475-4a9a-b335-6edfc3013781 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:59.218560 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3735068-b475-4a9a-b335-6edfc3013781 None admin] PATH_INFO: `/v3/users` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:59.219418 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3735068-b475-4a9a-b335-6edfc3013781 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:59.219734 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3735068-b475-4a9a-b335-6edfc3013781 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:59.222217 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3735068-b475-4a9a-b335-6edfc3013781 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:59.254012 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 316/629] 10.222.0.18 () {56 vars in 1137 bytes} [Tue Jul 26 15:25:58 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:59.256460 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44dc863-a50d-4f9d-b3a3-e504630012bb None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:59.257026 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44dc863-a50d-4f9d-b3a3-e504630012bb None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:59.257535 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44dc863-a50d-4f9d-b3a3-e504630012bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:59.284243 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-e44dc863-a50d-4f9d-b3a3-e504630012bb None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:25:59.285810 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-e44dc863-a50d-4f9d-b3a3-e504630012bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:25:59.329029 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29751b28-d563-409b-ac3f-b2ca49f15cf7 None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:59.385604 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 317/630] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:25:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:25:59.386921 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44dc863-a50d-4f9d-b3a3-e504630012bb None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:59.403558 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3f7e72-f96b-4b01-817c-e12cbbfa2fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:59.404684 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3f7e72-f96b-4b01-817c-e12cbbfa2fdf None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:59.405153 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3f7e72-f96b-4b01-817c-e12cbbfa2fdf None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:59.405569 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3f7e72-f96b-4b01-817c-e12cbbfa2fdf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:59.426844 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3f7e72-f96b-4b01-817c-e12cbbfa2fdf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:59.429380 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3f7e72-f96b-4b01-817c-e12cbbfa2fdf None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:59.450601 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-1a3f7e72-f96b-4b01-817c-e12cbbfa2fdf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:25:59.450601 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:25:59.450601 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:25:59.450601 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:25:59.450601 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:25:59.450601 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:25:59.450601 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:25:59.450601 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:25:59.450601 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:25:59.450601 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:25:59.450601 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:25:59.450601 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:25:59.450601 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:25:59.450601 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:25:59.450601 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:25:59.452106 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:25:59.452106 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:25:59.452106 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:25:59.452106 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:25:59.452106 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:25:59.452106 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:25:59.452106 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:25:59.452106 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:25:59.452106 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:25:59.452106 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:25:59.452106 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:25:59.452106 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:25:59.452106 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:25:59.452106 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:25:59.452106 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:25:59.452106 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:25:59.452106 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:25:59.453580 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:25:59.453580 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:25:59.453580 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:25:59.453580 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:25:59.456883 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 314/631] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 15:25:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:25:59.457843 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3f7e72-f96b-4b01-817c-e12cbbfa2fdf None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:59.504225 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:59.530335 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44dc863-a50d-4f9d-b3a3-e504630012bb None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:59.588128 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:59.595533 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a2edeb-4c65-4f3a-bfc0-f356ff38327a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:59.596335 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a2edeb-4c65-4f3a-bfc0-f356ff38327a None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:59.596798 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a2edeb-4c65-4f3a-bfc0-f356ff38327a None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:59.597279 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a2edeb-4c65-4f3a-bfc0-f356ff38327a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:59.604251 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3f7e72-f96b-4b01-817c-e12cbbfa2fdf None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:59.657487 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe97a55-f0cd-4256-ac74-629335a63371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:59.658480 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe97a55-f0cd-4256-ac74-629335a63371 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:59.658778 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe97a55-f0cd-4256-ac74-629335a63371 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:59.659028 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe97a55-f0cd-4256-ac74-629335a63371 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:59.675306 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe97a55-f0cd-4256-ac74-629335a63371 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:25:59.686866 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-cfe97a55-f0cd-4256-ac74-629335a63371 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 15:25:59.686866 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:25:59.686866 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:25:59.686866 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:25:59.686866 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:25:59.686866 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:25:59.686866 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:25:59.686866 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:25:59.686866 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:25:59.686866 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:25:59.686866 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:25:59.686866 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:25:59.686866 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:25:59.686866 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:25:59.686866 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:25:59.686866 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:25:59.688066 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:25:59.688066 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:25:59.688066 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:25:59.688066 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:25:59.688066 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:25:59.688066 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:25:59.688066 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:25:59.688066 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:25:59.688066 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:25:59.688066 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:25:59.688066 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:25:59.688066 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:25:59.688066 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:25:59.688066 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:25:59.688066 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:25:59.688066 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:25:59.689056 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:25:59.689056 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:25:59.689056 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:25:59.689056 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:25:59.689056 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:25:59.689056 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:25:59.689056 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:25:59.689056 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:25:59.689056 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:25:59.689056 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:25:59.689056 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 15:25:59.689056 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:25:59.689056 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 315/632] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jul 26 15:25:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:25:59.690603 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe97a55-f0cd-4256-ac74-629335a63371 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:59.699407 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a2edeb-4c65-4f3a-bfc0-f356ff38327a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:59.701205 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a2edeb-4c65-4f3a-bfc0-f356ff38327a None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:59.826177 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:59.826426 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe97a55-f0cd-4256-ac74-629335a63371 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:59.857886 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 318/633] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 15:25:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 15:25:59.857886 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a2edeb-4c65-4f3a-bfc0-f356ff38327a None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:59.875607 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3829c04d-2d6a-4c2f-9dbe-efedc593ebb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:59.876364 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3829c04d-2d6a-4c2f-9dbe-efedc593ebb3 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:59.876716 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3829c04d-2d6a-4c2f-9dbe-efedc593ebb3 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:59.877055 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3829c04d-2d6a-4c2f-9dbe-efedc593ebb3 None admin] PATH_INFO: `/v3/domains` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:59.877825 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3829c04d-2d6a-4c2f-9dbe-efedc593ebb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:25:59.878193 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3829c04d-2d6a-4c2f-9dbe-efedc593ebb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:59.879985 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3829c04d-2d6a-4c2f-9dbe-efedc593ebb3 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:59.900029 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 316/634] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 15:25:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:25:59.902093 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3829c04d-2d6a-4c2f-9dbe-efedc593ebb3 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:59.918977 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:00.014640 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a2edeb-4c65-4f3a-bfc0-f356ff38327a None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:00.054695 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3829c04d-2d6a-4c2f-9dbe-efedc593ebb3 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:00.065610 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b705dcdf-933f-442c-aa67-1e4d0318354f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:00.066342 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b705dcdf-933f-442c-aa67-1e4d0318354f None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:00.066630 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b705dcdf-933f-442c-aa67-1e4d0318354f None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:00.066903 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b705dcdf-933f-442c-aa67-1e4d0318354f None admin] PATH_INFO: `/v3/roles` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:00.067667 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b705dcdf-933f-442c-aa67-1e4d0318354f None admin] RBAC: Adding query filter params (name=admin) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:26:00.067973 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b705dcdf-933f-442c-aa67-1e4d0318354f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:00.069495 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b705dcdf-933f-442c-aa67-1e4d0318354f None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:00.081256 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 319/635] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 15:25:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:26:00.082697 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b705dcdf-933f-442c-aa67-1e4d0318354f None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:00.124375 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213c7aee-6dc9-4720-8c83-e0cb5880124f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:00.125653 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c7aee-6dc9-4720-8c83-e0cb5880124f None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:00.125945 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c7aee-6dc9-4720-8c83-e0cb5880124f None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:00.126234 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c7aee-6dc9-4720-8c83-e0cb5880124f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:00.141952 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:00.144784 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213c7aee-6dc9-4720-8c83-e0cb5880124f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:00.146295 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213c7aee-6dc9-4720-8c83-e0cb5880124f None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:00.162557 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-213c7aee-6dc9-4720-8c83-e0cb5880124f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:26:00.162557 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:26:00.162557 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:26:00.162557 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:26:00.162557 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:26:00.162557 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:26:00.162557 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:26:00.162557 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:26:00.162557 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:26:00.162557 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:26:00.162557 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:26:00.162557 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:26:00.162557 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:26:00.162557 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:26:00.162557 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:26:00.163807 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:26:00.163807 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:26:00.163807 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:26:00.163807 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:26:00.163807 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:26:00.163807 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:26:00.163807 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:26:00.163807 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:26:00.163807 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:26:00.163807 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:26:00.163807 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:26:00.163807 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:26:00.163807 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:26:00.163807 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:26:00.163807 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:26:00.163807 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:26:00.163807 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:26:00.165653 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:26:00.165653 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:26:00.165653 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:26:00.165653 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:26:00.165653 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 317/636] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 15:25:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:26:00.165653 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213c7aee-6dc9-4720-8c83-e0cb5880124f None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:00.231966 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b705dcdf-933f-442c-aa67-1e4d0318354f None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:00.240483 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:00.286882 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646733d0-13ae-46fd-9c7c-af74aaa31780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:00.288003 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646733d0-13ae-46fd-9c7c-af74aaa31780 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:00.288515 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646733d0-13ae-46fd-9c7c-af74aaa31780 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:00.289011 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646733d0-13ae-46fd-9c7c-af74aaa31780 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:00.294785 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213c7aee-6dc9-4720-8c83-e0cb5880124f None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:00.300707 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646733d0-13ae-46fd-9c7c-af74aaa31780 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:00.303507 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646733d0-13ae-46fd-9c7c-af74aaa31780 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:00.324416 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application [None req-646733d0-13ae-46fd-9c7c-af74aaa31780 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:26:00.324416 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:26:00.324416 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:26:00.324416 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:26:00.324416 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:26:00.324416 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:26:00.324416 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:26:00.324416 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:26:00.324416 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:26:00.324416 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:26:00.324416 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:26:00.324416 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:26:00.324416 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 15:26:00.324416 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 15:26:00.324416 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 15:26:00.325423 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 15:26:00.325423 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:26:00.325423 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:26:00.325423 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:26:00.325423 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:26:00.325423 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:26:00.325423 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:26:00.325423 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:26:00.325423 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application with Lock( Jul 26 15:26:00.325423 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:26:00.325423 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:26:00.325423 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:26:00.325423 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:26:00.325423 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:26:00.325423 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:26:00.325423 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:26:00.325423 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:26:00.326323 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 15:26:00.326323 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 15:26:00.326323 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 15:26:00.326323 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 15:26:00.326323 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 15:26:00.326323 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 15:26:00.326323 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:26:00.326323 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:26:00.326756 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 320/637] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 15:26:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:26:00.327791 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646733d0-13ae-46fd-9c7c-af74aaa31780 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:00.346526 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6281db34-6ef4-4046-8276-348b278207e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:00.347634 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281db34-6ef4-4046-8276-348b278207e9 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:00.347779 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281db34-6ef4-4046-8276-348b278207e9 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:00.348041 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281db34-6ef4-4046-8276-348b278207e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:00.362386 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6281db34-6ef4-4046-8276-348b278207e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:00.364367 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6281db34-6ef4-4046-8276-348b278207e9 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:00.382450 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-6281db34-6ef4-4046-8276-348b278207e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:26:00.382450 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:26:00.382450 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:26:00.382450 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:26:00.382450 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:26:00.382450 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:26:00.382450 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:26:00.382450 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:26:00.382450 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:26:00.382450 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:26:00.382450 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:26:00.382450 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:26:00.382450 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:26:00.382450 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:26:00.382450 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:26:00.385134 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:26:00.385134 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:26:00.385134 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:26:00.385134 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:26:00.385134 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:26:00.385134 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:26:00.385134 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:26:00.385134 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:26:00.385134 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:26:00.385134 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:26:00.385134 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:26:00.385134 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:26:00.385134 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:26:00.385134 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:26:00.385134 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:26:00.385134 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:26:00.385134 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:26:00.387228 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:26:00.387228 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:26:00.387228 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:26:00.387228 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:26:00.387228 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 318/638] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 15:26:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:26:00.387228 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6281db34-6ef4-4046-8276-348b278207e9 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:00.505445 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646733d0-13ae-46fd-9c7c-af74aaa31780 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:00.515927 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:00.533148 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6281db34-6ef4-4046-8276-348b278207e9 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:00.551169 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:00.558552 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013eec71-f739-4f3f-aa49-36181d7f4492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:00.559615 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013eec71-f739-4f3f-aa49-36181d7f4492 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:00.562187 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013eec71-f739-4f3f-aa49-36181d7f4492 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:00.562187 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013eec71-f739-4f3f-aa49-36181d7f4492 None admin] PATH_INFO: `/v3/domains` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:00.562187 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013eec71-f739-4f3f-aa49-36181d7f4492 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:26:00.562583 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013eec71-f739-4f3f-aa49-36181d7f4492 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:00.565176 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013eec71-f739-4f3f-aa49-36181d7f4492 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:00.575192 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f26437-f167-4990-865d-2b7e229ac940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:00.575830 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f26437-f167-4990-865d-2b7e229ac940 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:00.576175 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f26437-f167-4990-865d-2b7e229ac940 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:00.576447 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f26437-f167-4990-865d-2b7e229ac940 None admin] PATH_INFO: `/v3/projects` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:00.577728 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f26437-f167-4990-865d-2b7e229ac940 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:26:00.578469 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f26437-f167-4990-865d-2b7e229ac940 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:00.580074 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f26437-f167-4990-865d-2b7e229ac940 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:00.592268 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 321/639] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 15:26:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:26:00.592268 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013eec71-f739-4f3f-aa49-36181d7f4492 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:00.599184 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 319/640] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jul 26 15:26:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:26:00.599966 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f26437-f167-4990-865d-2b7e229ac940 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:00.737404 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013eec71-f739-4f3f-aa49-36181d7f4492 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:00.747872 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f26437-f167-4990-865d-2b7e229ac940 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:00.777525 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb38e9ca-7988-41e3-a554-880a4d4b94b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:00.778082 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb38e9ca-7988-41e3-a554-880a4d4b94b9 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:00.778355 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb38e9ca-7988-41e3-a554-880a4d4b94b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:00.778626 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb38e9ca-7988-41e3-a554-880a4d4b94b9 None admin] PATH_INFO: `/v3/domains` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:00.779363 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb38e9ca-7988-41e3-a554-880a4d4b94b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:26:00.779672 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb38e9ca-7988-41e3-a554-880a4d4b94b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:00.781050 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb38e9ca-7988-41e3-a554-880a4d4b94b9 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:00.789064 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678ea316-182d-47cf-83c0-b9cd3aa7323e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:00.789717 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ea316-182d-47cf-83c0-b9cd3aa7323e None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:00.789990 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ea316-182d-47cf-83c0-b9cd3aa7323e None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:00.790266 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ea316-182d-47cf-83c0-b9cd3aa7323e None admin] PATH_INFO: `/v3/projects/service` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:00.798867 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678ea316-182d-47cf-83c0-b9cd3aa7323e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:00.799352 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 322/641] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 15:26:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:26:00.800201 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678ea316-182d-47cf-83c0-b9cd3aa7323e None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:00.800685 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb38e9ca-7988-41e3-a554-880a4d4b94b9 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:00.813001 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-678ea316-182d-47cf-83c0-b9cd3aa7323e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:26:00.813001 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:26:00.813001 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:26:00.813001 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:26:00.813001 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:26:00.813001 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:26:00.813001 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:26:00.813001 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:26:00.813001 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:26:00.813001 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:26:00.813001 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:26:00.813001 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:26:00.813001 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 15:26:00.813001 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 15:26:00.813001 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 15:26:00.814116 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 15:26:00.814116 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:26:00.814116 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:26:00.814116 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:26:00.814116 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:26:00.814116 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:26:00.814116 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:26:00.814116 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:26:00.814116 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:26:00.814116 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:26:00.814116 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:26:00.814116 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:26:00.814116 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:26:00.814116 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:26:00.814116 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:26:00.814116 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:26:00.814116 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:26:00.815015 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 15:26:00.815015 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 15:26:00.815015 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 15:26:00.815015 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 15:26:00.815015 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 15:26:00.815015 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 15:26:00.815015 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:26:00.815015 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:26:00.815015 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 320/642] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 15:26:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:26:00.815541 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678ea316-182d-47cf-83c0-b9cd3aa7323e None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:00.854155 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:00.859104 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:00.954426 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678ea316-182d-47cf-83c0-b9cd3aa7323e None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:00.971947 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb38e9ca-7988-41e3-a554-880a4d4b94b9 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:01.009605 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76de21a5-1754-4c82-8b21-d89fb7dfb7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:01.010488 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76de21a5-1754-4c82-8b21-d89fb7dfb7c1 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:01.011535 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76de21a5-1754-4c82-8b21-d89fb7dfb7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:01.011970 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76de21a5-1754-4c82-8b21-d89fb7dfb7c1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:01.020873 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76de21a5-1754-4c82-8b21-d89fb7dfb7c1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:01.022457 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76de21a5-1754-4c82-8b21-d89fb7dfb7c1 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:01.036019 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-76de21a5-1754-4c82-8b21-d89fb7dfb7c1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 15:26:01.036019 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:26:01.036019 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:26:01.036019 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:26:01.036019 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:26:01.036019 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:26:01.036019 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:26:01.036019 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:26:01.036019 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:26:01.036019 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:26:01.036019 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:26:01.036019 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:26:01.036019 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 15:26:01.036019 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 15:26:01.036019 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 15:26:01.036019 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 15:26:01.037240 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:26:01.037240 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:26:01.037240 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 15:26:01.037240 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:26:01.037240 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 15:26:01.037240 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:26:01.037240 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:26:01.037240 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:26:01.037240 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:26:01.037240 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:26:01.037240 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:26:01.037240 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:26:01.037240 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:26:01.037240 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:26:01.037240 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:26:01.037240 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:26:01.037240 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:26:01.037240 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:26:01.038350 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:26:01.038350 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:26:01.038350 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 15:26:01.038350 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 15:26:01.038350 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 15:26:01.038350 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 15:26:01.038350 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 15:26:01.038350 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 15:26:01.038350 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 15:26:01.038350 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:26:01.041786 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c5953e-8777-426f-bd20-29b6dafb7f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:01.043335 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c5953e-8777-426f-bd20-29b6dafb7f04 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:01.044412 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 321/643] 10.222.0.18 () {56 vars in 1093 bytes} [Tue Jul 26 15:26:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:26:01.046029 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c5953e-8777-426f-bd20-29b6dafb7f04 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:01.046147 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76de21a5-1754-4c82-8b21-d89fb7dfb7c1 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:01.046237 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c5953e-8777-426f-bd20-29b6dafb7f04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:01.046718 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c5953e-8777-426f-bd20-29b6dafb7f04 None admin] RBAC: Adding query filter params (role.id=2a6f012a2a004fbb8ab4d8a5f8633a22, scope.project.id=9178e468facc41d6a7d828dfcd5301b4, user.id=d903ca1082154ef2bfac7156d22ddac6) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:26:01.047685 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c5953e-8777-426f-bd20-29b6dafb7f04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:01.052403 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c5953e-8777-426f-bd20-29b6dafb7f04 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:01.075231 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 323/644] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 26 15:26:00 2022] GET /identity/v3/role_assignments?user.id=d903ca1082154ef2bfac7156d22ddac6&scope.project.id=9178e468facc41d6a7d828dfcd5301b4&role.id=2a6f012a2a004fbb8ab4d8a5f8633a22 => generated 608 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:26:01.075231 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c5953e-8777-426f-bd20-29b6dafb7f04 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:01.235356 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:01.254850 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76de21a5-1754-4c82-8b21-d89fb7dfb7c1 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:01.298480 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:01.318809 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c5953e-8777-426f-bd20-29b6dafb7f04 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:01.334780 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbe135a-eef3-426c-b5c1-037334672626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:01.336155 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe135a-eef3-426c-b5c1-037334672626 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:01.336612 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe135a-eef3-426c-b5c1-037334672626 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:01.337246 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe135a-eef3-426c-b5c1-037334672626 None admin] PATH_INFO: `/v3/projects` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:01.339483 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbe135a-eef3-426c-b5c1-037334672626 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:26:01.340256 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbe135a-eef3-426c-b5c1-037334672626 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:01.343072 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbe135a-eef3-426c-b5c1-037334672626 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:01.366999 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 322/645] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jul 26 15:26:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:26:01.376882 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbe135a-eef3-426c-b5c1-037334672626 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:01.390536 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae24a7c1-bd3a-4d7c-a4a2-d38444590a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:01.391709 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae24a7c1-bd3a-4d7c-a4a2-d38444590a06 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:01.392167 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae24a7c1-bd3a-4d7c-a4a2-d38444590a06 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:01.392632 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae24a7c1-bd3a-4d7c-a4a2-d38444590a06 None admin] PATH_INFO: `/v3/users` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:01.394142 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae24a7c1-bd3a-4d7c-a4a2-d38444590a06 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:26:01.394680 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae24a7c1-bd3a-4d7c-a4a2-d38444590a06 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:01.396867 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae24a7c1-bd3a-4d7c-a4a2-d38444590a06 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:01.428262 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 324/646] 10.222.0.18 () {56 vars in 1133 bytes} [Tue Jul 26 15:26:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:26:01.430396 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a09bf0-5499-4171-a3c0-1ea34d76a151 None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:01.430736 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a09bf0-5499-4171-a3c0-1ea34d76a151 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:01.431045 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a09bf0-5499-4171-a3c0-1ea34d76a151 None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:01.433494 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 325/647] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:26:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:26:01.439601 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c97f76a-7b9d-4cc7-a22a-3d2db2faa38f None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:01.439887 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c97f76a-7b9d-4cc7-a22a-3d2db2faa38f None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:01.440157 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c97f76a-7b9d-4cc7-a22a-3d2db2faa38f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:01.460604 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-3c97f76a-7b9d-4cc7-a22a-3d2db2faa38f None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:26:01.462517 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-3c97f76a-7b9d-4cc7-a22a-3d2db2faa38f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:26:01.572402 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 326/648] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:26:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 15:26:01.576702 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbe135a-eef3-426c-b5c1-037334672626 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:01.577985 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c97f76a-7b9d-4cc7-a22a-3d2db2faa38f None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:01.636879 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7be919-e6d6-482c-8247-74ed126e0b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:01.638389 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7be919-e6d6-482c-8247-74ed126e0b4f None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:01.638914 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7be919-e6d6-482c-8247-74ed126e0b4f None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:01.639448 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7be919-e6d6-482c-8247-74ed126e0b4f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:01.640558 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7be919-e6d6-482c-8247-74ed126e0b4f None admin] RBAC: Adding query filter params (role.id=2a6f012a2a004fbb8ab4d8a5f8633a22, scope.project.id=9178e468facc41d6a7d828dfcd5301b4, user.id=279031fbf2114c11883018b0d41e243a) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:26:01.641117 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7be919-e6d6-482c-8247-74ed126e0b4f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:01.642788 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7be919-e6d6-482c-8247-74ed126e0b4f None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:01.659172 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 323/649] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 26 15:26:01 2022] GET /identity/v3/role_assignments?user.id=279031fbf2114c11883018b0d41e243a&scope.project.id=9178e468facc41d6a7d828dfcd5301b4&role.id=2a6f012a2a004fbb8ab4d8a5f8633a22 => generated 608 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:26:01.659172 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7be919-e6d6-482c-8247-74ed126e0b4f None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:01.698947 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:01.727953 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:01.783534 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c97f76a-7b9d-4cc7-a22a-3d2db2faa38f None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:01.840317 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c8ec2f-aac8-4a0d-a29f-0f665a66c7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:01.840849 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c8ec2f-aac8-4a0d-a29f-0f665a66c7bc None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:01.841127 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c8ec2f-aac8-4a0d-a29f-0f665a66c7bc None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:01.841400 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c8ec2f-aac8-4a0d-a29f-0f665a66c7bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:01.848732 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7be919-e6d6-482c-8247-74ed126e0b4f None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:01.903207 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8639e51d-995a-490b-a215-d65721b4701e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:01.904629 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8639e51d-995a-490b-a215-d65721b4701e None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:01.904629 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8639e51d-995a-490b-a215-d65721b4701e None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:01.904629 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8639e51d-995a-490b-a215-d65721b4701e None admin] PATH_INFO: `/v3/services/network` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:01.905297 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8639e51d-995a-490b-a215-d65721b4701e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:01.906753 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8639e51d-995a-490b-a215-d65721b4701e None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:01.920174 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-8639e51d-995a-490b-a215-d65721b4701e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 15:26:01.920174 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:26:01.920174 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 15:26:01.920174 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 15:26:01.920174 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 15:26:01.920174 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 15:26:01.920174 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 15:26:01.920174 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 15:26:01.920174 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 15:26:01.920174 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:26:01.920174 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 15:26:01.920174 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:26:01.920174 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:26:01.920174 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:26:01.920174 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:26:01.920174 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:26:01.920174 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:26:01.921237 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:26:01.921237 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:26:01.921237 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:26:01.921237 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:26:01.921237 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:26:01.921237 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:26:01.921237 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 15:26:01.921237 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 15:26:01.921237 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 15:26:01.921237 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 15:26:01.921237 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:26:01.921237 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:26:01.921237 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:26:01.921237 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:26:01.921237 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:26:01.921237 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:26:01.922400 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:26:01.922400 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:26:01.922400 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:26:01.922400 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:26:01.922400 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:26:01.922400 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:26:01.922400 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:26:01.922400 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:26:01.922400 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:26:01.922400 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:26:01.922400 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 15:26:01.922400 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 15:26:01.922400 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 15:26:01.922400 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:26:01.922400 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 324/650] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 15:26:01 2022] GET /identity/v3/services/network => generated 88 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:26:01.937776 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c8ec2f-aac8-4a0d-a29f-0f665a66c7bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:01.939332 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c8ec2f-aac8-4a0d-a29f-0f665a66c7bc None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:01.944744 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8639e51d-995a-490b-a215-d65721b4701e None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:02.087821 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:02.098224 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:02.135205 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8639e51d-995a-490b-a215-d65721b4701e None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:02.143545 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 327/651] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 15:26:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 570 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 15:26:02.151169 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c8ec2f-aac8-4a0d-a29f-0f665a66c7bc None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:02.175678 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392797f4-d25f-4482-8999-c14f83b6ed33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:02.176316 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392797f4-d25f-4482-8999-c14f83b6ed33 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:02.176596 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392797f4-d25f-4482-8999-c14f83b6ed33 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:02.176880 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392797f4-d25f-4482-8999-c14f83b6ed33 None admin] PATH_INFO: `/v3/services` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:02.177642 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392797f4-d25f-4482-8999-c14f83b6ed33 None admin] RBAC: Adding query filter params (name=network) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:26:02.177956 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392797f4-d25f-4482-8999-c14f83b6ed33 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:02.179494 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392797f4-d25f-4482-8999-c14f83b6ed33 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:02.187599 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 325/652] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Jul 26 15:26:01 2022] GET /identity/v3/services?name=network => generated 124 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:26:02.194337 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392797f4-d25f-4482-8999-c14f83b6ed33 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:02.349929 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c8ec2f-aac8-4a0d-a29f-0f665a66c7bc None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:02.385058 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392797f4-d25f-4482-8999-c14f83b6ed33 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:02.412314 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd03687-bd07-4f94-87ae-838df9ed4c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:02.413973 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd03687-bd07-4f94-87ae-838df9ed4c89 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:02.414600 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd03687-bd07-4f94-87ae-838df9ed4c89 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:02.415177 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd03687-bd07-4f94-87ae-838df9ed4c89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:02.435431 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd03687-bd07-4f94-87ae-838df9ed4c89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:02.438817 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd03687-bd07-4f94-87ae-838df9ed4c89 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:02.447361 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b608bbb-27e3-4174-af03-434c154536aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:02.448008 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b608bbb-27e3-4174-af03-434c154536aa None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:02.448341 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b608bbb-27e3-4174-af03-434c154536aa None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:02.448619 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b608bbb-27e3-4174-af03-434c154536aa None admin] PATH_INFO: `/v3/services` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:02.449351 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b608bbb-27e3-4174-af03-434c154536aa None admin] RBAC: Adding query filter params (type=network) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:26:02.449642 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b608bbb-27e3-4174-af03-434c154536aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:02.451701 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b608bbb-27e3-4174-af03-434c154536aa None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:02.463166 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 326/653] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Jul 26 15:26:02 2022] GET /identity/v3/services?type=network => generated 124 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:26:02.463599 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application [None req-9cd03687-bd07-4f94-87ae-838df9ed4c89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:26:02.463599 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:26:02.463599 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:26:02.463599 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:26:02.463599 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:26:02.463599 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:26:02.463599 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:26:02.463599 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:26:02.463599 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:26:02.463599 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:26:02.463599 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:26:02.463599 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:26:02.463599 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:26:02.463599 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:26:02.463599 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:26:02.465584 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:26:02.465584 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:26:02.465584 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:26:02.465584 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:26:02.465584 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:26:02.465584 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:26:02.465584 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:26:02.465584 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:26:02.465584 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application with Lock( Jul 26 15:26:02.465584 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:26:02.465584 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:26:02.465584 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:26:02.465584 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:26:02.465584 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:26:02.465584 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:26:02.465584 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:26:02.465584 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:26:02.466698 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:26:02.466698 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:26:02.466698 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:26:02.466698 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:26:02.470357 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 328/654] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 15:26:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:26:02.472416 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b608bbb-27e3-4174-af03-434c154536aa None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:02.486120 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:02.639381 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b608bbb-27e3-4174-af03-434c154536aa None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:02.703893 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29fcf2d-7c3c-4425-bc63-7d0aacda0615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:02.704804 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29fcf2d-7c3c-4425-bc63-7d0aacda0615 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:02.705123 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29fcf2d-7c3c-4425-bc63-7d0aacda0615 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:02.705404 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29fcf2d-7c3c-4425-bc63-7d0aacda0615 None admin] PATH_INFO: `/v3/domains` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:02.706345 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29fcf2d-7c3c-4425-bc63-7d0aacda0615 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:26:02.706657 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29fcf2d-7c3c-4425-bc63-7d0aacda0615 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:02.708726 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29fcf2d-7c3c-4425-bc63-7d0aacda0615 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:02.731284 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 327/655] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 15:26:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:26:02.736765 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd03687-bd07-4f94-87ae-838df9ed4c89 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:02.793713 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:02.903247 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd03687-bd07-4f94-87ae-838df9ed4c89 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:02.944566 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485e23ef-cf60-4dd1-9fc3-becc930667a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:02.945221 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e23ef-cf60-4dd1-9fc3-becc930667a2 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:02.945505 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e23ef-cf60-4dd1-9fc3-becc930667a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:02.945787 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e23ef-cf60-4dd1-9fc3-becc930667a2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:02.957878 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485e23ef-cf60-4dd1-9fc3-becc930667a2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:02.960228 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485e23ef-cf60-4dd1-9fc3-becc930667a2 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:02.976704 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application [None req-485e23ef-cf60-4dd1-9fc3-becc930667a2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:26:02.976704 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:26:02.976704 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:26:02.976704 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:26:02.976704 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:26:02.976704 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:26:02.976704 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:26:02.976704 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:26:02.976704 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:26:02.976704 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:26:02.976704 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:26:02.976704 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:26:02.976704 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 15:26:02.976704 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 15:26:02.976704 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 15:26:02.977599 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 15:26:02.977599 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:26:02.977599 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:26:02.977599 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:26:02.977599 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:26:02.977599 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:26:02.977599 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:26:02.977599 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:26:02.977599 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application with Lock( Jul 26 15:26:02.977599 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:26:02.977599 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:26:02.977599 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:26:02.977599 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:26:02.977599 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:26:02.977599 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:26:02.977599 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:26:02.977599 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:26:02.978535 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 15:26:02.978535 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 15:26:02.978535 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 15:26:02.978535 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 15:26:02.978535 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 15:26:02.978535 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 15:26:02.978535 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:26:02.978535 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:26:02.978535 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 329/656] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 15:26:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:26:02.985352 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29fcf2d-7c3c-4425-bc63-7d0aacda0615 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:03.088173 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:03.131687 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29fcf2d-7c3c-4425-bc63-7d0aacda0615 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:03.174490 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d624b8-92d0-4fd9-97c6-0681c7e371e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:03.175460 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d624b8-92d0-4fd9-97c6-0681c7e371e7 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:03.175967 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d624b8-92d0-4fd9-97c6-0681c7e371e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:03.176393 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d624b8-92d0-4fd9-97c6-0681c7e371e7 None admin] PATH_INFO: `/v3/projects` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:03.177340 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d624b8-92d0-4fd9-97c6-0681c7e371e7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:26:03.177806 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d624b8-92d0-4fd9-97c6-0681c7e371e7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:03.179510 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d624b8-92d0-4fd9-97c6-0681c7e371e7 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:03.194109 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 328/657] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jul 26 15:26:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:26:03.203526 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485e23ef-cf60-4dd1-9fc3-becc930667a2 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:03.323916 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:03.335031 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485e23ef-cf60-4dd1-9fc3-becc930667a2 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:03.391400 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b00fb8-d71e-4517-8588-64a53aca87c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:03.392437 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b00fb8-d71e-4517-8588-64a53aca87c8 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:03.392945 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b00fb8-d71e-4517-8588-64a53aca87c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:03.393451 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b00fb8-d71e-4517-8588-64a53aca87c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:03.394969 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b00fb8-d71e-4517-8588-64a53aca87c8 None admin] RBAC: Adding query filter params (role.id=2c659645e15c4204b1457556939397cb, scope.project.id=9178e468facc41d6a7d828dfcd5301b4, user.id=fbc5f2b36d3f45f1b3c8155e46c46fda) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:26:03.395578 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b00fb8-d71e-4517-8588-64a53aca87c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:03.398283 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b00fb8-d71e-4517-8588-64a53aca87c8 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:03.410460 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 330/658] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 26 15:26:03 2022] GET /identity/v3/role_assignments?user.id=fbc5f2b36d3f45f1b3c8155e46c46fda&scope.project.id=9178e468facc41d6a7d828dfcd5301b4&role.id=2c659645e15c4204b1457556939397cb => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:26:04.087901 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd26e82-751d-4400-8661-10db70d70bc1 None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:04.088462 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd26e82-751d-4400-8661-10db70d70bc1 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:04.088912 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd26e82-751d-4400-8661-10db70d70bc1 None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:04.091972 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 329/659] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:26:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:26:04.100879 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c7b91-e12c-4c97-9f5c-191842d733c8 None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:04.101303 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c7b91-e12c-4c97-9f5c-191842d733c8 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:04.101729 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c7b91-e12c-4c97-9f5c-191842d733c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:04.131739 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-df6c7b91-e12c-4c97-9f5c-191842d733c8 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:26:04.133073 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-df6c7b91-e12c-4c97-9f5c-191842d733c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:26:04.210709 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 331/660] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:26:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:26:04.251037 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd26e82-751d-4400-8661-10db70d70bc1 None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:04.275225 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c5d20-b32f-43d7-a204-17281e76eb7e None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:04.275882 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c5d20-b32f-43d7-a204-17281e76eb7e None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:04.277014 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c5d20-b32f-43d7-a204-17281e76eb7e None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:04.279243 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 332/661] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:26:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 15:26:04.285455 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd6bc4-1873-4773-bd4a-ed32db2e9e34 None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:04.286100 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd6bc4-1873-4773-bd4a-ed32db2e9e34 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:04.286555 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd6bc4-1873-4773-bd4a-ed32db2e9e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:04.309168 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-e4fd6bc4-1873-4773-bd4a-ed32db2e9e34 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:26:04.311075 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-e4fd6bc4-1873-4773-bd4a-ed32db2e9e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:26:04.400392 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 333/662] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:26:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 15:26:04.443748 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fd6bc4-1873-4773-bd4a-ed32db2e9e34 None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:04.463246 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd26e82-751d-4400-8661-10db70d70bc1 None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:04.473567 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:04.518874 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:04.536967 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b22634-41df-4a47-8337-b5c6b0aca9d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:04.538083 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b22634-41df-4a47-8337-b5c6b0aca9d8 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:04.538718 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b22634-41df-4a47-8337-b5c6b0aca9d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:04.539366 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b22634-41df-4a47-8337-b5c6b0aca9d8 None admin] PATH_INFO: `/v3/services/image` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:04.540755 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b22634-41df-4a47-8337-b5c6b0aca9d8 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:04.544437 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b22634-41df-4a47-8337-b5c6b0aca9d8 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:04.564572 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-83b22634-41df-4a47-8337-b5c6b0aca9d8 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 15:26:04.564572 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:26:04.564572 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 15:26:04.564572 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 15:26:04.564572 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 15:26:04.564572 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 15:26:04.564572 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 15:26:04.564572 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 15:26:04.564572 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 15:26:04.564572 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:26:04.564572 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 15:26:04.564572 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:26:04.564572 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:26:04.564572 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:26:04.564572 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:26:04.564572 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:26:04.564572 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:26:04.571374 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:26:04.571374 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:26:04.571374 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:26:04.571374 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:26:04.571374 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:26:04.571374 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:26:04.571374 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 15:26:04.571374 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 15:26:04.571374 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 15:26:04.571374 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 15:26:04.571374 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:26:04.571374 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:26:04.571374 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:26:04.571374 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:26:04.571374 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:26:04.571374 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:26:04.573282 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:26:04.573282 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:26:04.573282 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:26:04.573282 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:26:04.573282 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:26:04.573282 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:26:04.573282 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:26:04.573282 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:26:04.573282 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:26:04.573282 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:26:04.573282 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 15:26:04.573282 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 15:26:04.573282 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 15:26:04.573282 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:26:04.573282 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 330/663] 10.222.0.18 () {56 vars in 1105 bytes} [Tue Jul 26 15:26:04 2022] GET /identity/v3/services/image => generated 86 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:26:04.581546 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b22634-41df-4a47-8337-b5c6b0aca9d8 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:04.673285 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fd6bc4-1873-4773-bd4a-ed32db2e9e34 None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:04.742313 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b267ae-58f3-47db-9aa8-52a1a927911b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:04.743364 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b267ae-58f3-47db-9aa8-52a1a927911b None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:04.743870 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b267ae-58f3-47db-9aa8-52a1a927911b None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:04.744361 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b267ae-58f3-47db-9aa8-52a1a927911b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:04.746041 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b267ae-58f3-47db-9aa8-52a1a927911b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:04.748783 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b267ae-58f3-47db-9aa8-52a1a927911b None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:04.770758 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application [None req-b5b267ae-58f3-47db-9aa8-52a1a927911b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 15:26:04.770758 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:26:04.770758 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 15:26:04.770758 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 15:26:04.770758 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 15:26:04.770758 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 15:26:04.770758 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 15:26:04.770758 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 15:26:04.770758 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 15:26:04.770758 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:26:04.770758 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 15:26:04.770758 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:26:04.770758 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:26:04.770758 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:26:04.770758 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:26:04.770758 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:26:04.778095 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:26:04.778095 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:26:04.778095 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:26:04.778095 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:26:04.778095 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:26:04.778095 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:26:04.778095 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:26:04.778095 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 15:26:04.778095 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 15:26:04.778095 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 15:26:04.778095 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 15:26:04.778095 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:26:04.778095 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:26:04.778095 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:26:04.778095 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:26:04.778095 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:26:04.780983 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:26:04.780983 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:26:04.780983 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application with Lock( Jul 26 15:26:04.780983 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:26:04.780983 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:26:04.780983 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:26:04.780983 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:26:04.780983 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:26:04.780983 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:26:04.780983 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:26:04.780983 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:26:04.780983 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 15:26:04.780983 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 15:26:04.780983 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 15:26:04.780983 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:26:04.780983 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 334/664] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Jul 26 15:26:04 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 15:26:04.785792 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b267ae-58f3-47db-9aa8-52a1a927911b None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:04.816035 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b22634-41df-4a47-8337-b5c6b0aca9d8 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:04.882253 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0a7aff-35f0-4e0f-930e-08bddb11f21a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:04.883789 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a7aff-35f0-4e0f-930e-08bddb11f21a None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:04.884608 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a7aff-35f0-4e0f-930e-08bddb11f21a None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:04.885367 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a7aff-35f0-4e0f-930e-08bddb11f21a None admin] PATH_INFO: `/v3/services` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:04.887343 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0a7aff-35f0-4e0f-930e-08bddb11f21a None admin] RBAC: Adding query filter params (name=image) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:26:04.888363 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0a7aff-35f0-4e0f-930e-08bddb11f21a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:04.891268 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0a7aff-35f0-4e0f-930e-08bddb11f21a None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:04.907292 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 331/665] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 15:26:04 2022] GET /identity/v3/services?name=image => generated 122 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:26:04.910626 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0a7aff-35f0-4e0f-930e-08bddb11f21a None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:04.944152 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:04.991966 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b267ae-58f3-47db-9aa8-52a1a927911b None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:05.034848 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:05.067220 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589c8860-6f3d-46e7-a31f-69c59cb1136f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:05.068065 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c8860-6f3d-46e7-a31f-69c59cb1136f None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:05.068518 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c8860-6f3d-46e7-a31f-69c59cb1136f None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:05.068968 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c8860-6f3d-46e7-a31f-69c59cb1136f None admin] PATH_INFO: `/v3/services` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:05.070144 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589c8860-6f3d-46e7-a31f-69c59cb1136f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:26:05.070681 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589c8860-6f3d-46e7-a31f-69c59cb1136f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:05.074147 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589c8860-6f3d-46e7-a31f-69c59cb1136f None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:05.090665 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 335/666] 10.222.0.18 () {56 vars in 1124 bytes} [Tue Jul 26 15:26:04 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:26:05.094327 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589c8860-6f3d-46e7-a31f-69c59cb1136f None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:05.133934 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0a7aff-35f0-4e0f-930e-08bddb11f21a None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:05.202060 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc18ae-fbd0-406b-8949-addebec45a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:05.203724 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc18ae-fbd0-406b-8949-addebec45a27 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:05.204649 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc18ae-fbd0-406b-8949-addebec45a27 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:05.205495 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc18ae-fbd0-406b-8949-addebec45a27 None admin] PATH_INFO: `/v3/services` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:05.207207 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bc18ae-fbd0-406b-8949-addebec45a27 None admin] RBAC: Adding query filter params (type=image) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:26:05.208239 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bc18ae-fbd0-406b-8949-addebec45a27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:05.211725 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bc18ae-fbd0-406b-8949-addebec45a27 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:05.221697 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 332/667] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 15:26:04 2022] GET /identity/v3/services?type=image => generated 122 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:26:05.294319 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589c8860-6f3d-46e7-a31f-69c59cb1136f None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:05.346987 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff00a09-a63a-4616-95e7-ebcb07320b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:05.348142 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff00a09-a63a-4616-95e7-ebcb07320b3a None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:05.348652 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff00a09-a63a-4616-95e7-ebcb07320b3a None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:05.349153 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff00a09-a63a-4616-95e7-ebcb07320b3a None admin] PATH_INFO: `/v3/services` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:05.350122 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff00a09-a63a-4616-95e7-ebcb07320b3a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:26:05.350670 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff00a09-a63a-4616-95e7-ebcb07320b3a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:05.352438 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff00a09-a63a-4616-95e7-ebcb07320b3a None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:05.360843 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 336/668] 10.222.0.18 () {56 vars in 1124 bytes} [Tue Jul 26 15:26:05 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:26:05.559717 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f2de2-0acd-40f9-959c-f667be072ce3 None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:05.560091 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f2de2-0acd-40f9-959c-f667be072ce3 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:05.560518 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f2de2-0acd-40f9-959c-f667be072ce3 None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:05.563619 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 333/669] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:26:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:26:05.572392 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149fc317-a6b8-4b68-812e-a0908bede739 None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:05.572919 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149fc317-a6b8-4b68-812e-a0908bede739 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:05.573250 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149fc317-a6b8-4b68-812e-a0908bede739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:05.592220 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:05.601158 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-149fc317-a6b8-4b68-812e-a0908bede739 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:26:05.603001 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-149fc317-a6b8-4b68-812e-a0908bede739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:26:05.751433 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 337/670] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:26:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:26:05.784594 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f2de2-0acd-40f9-959c-f667be072ce3 None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:06.000598 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f2de2-0acd-40f9-959c-f667be072ce3 None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:06.041424 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:06.067845 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713cb946-895f-4863-9560-a8cf12fc3d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:06.068531 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713cb946-895f-4863-9560-a8cf12fc3d8a None admin] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:06.069019 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713cb946-895f-4863-9560-a8cf12fc3d8a None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:06.069494 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713cb946-895f-4863-9560-a8cf12fc3d8a None admin] PATH_INFO: `/v3/services` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:06.070495 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713cb946-895f-4863-9560-a8cf12fc3d8a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:06.072168 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713cb946-895f-4863-9560-a8cf12fc3d8a None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:06.169361 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 334/671] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Jul 26 15:26:05 2022] POST /identity/v3/services => generated 240 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:26:06.527675 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c2d303-7a87-448c-923c-c7cef4610f88 None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:06.528389 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c2d303-7a87-448c-923c-c7cef4610f88 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:06.528887 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c2d303-7a87-448c-923c-c7cef4610f88 None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:06.530853 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 338/672] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:26:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:26:06.536823 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f2918-221e-47bf-a976-79159beeea7b None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:06.537464 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f2918-221e-47bf-a976-79159beeea7b None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:06.537947 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f2918-221e-47bf-a976-79159beeea7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:06.559015 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-389f2918-221e-47bf-a976-79159beeea7b None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:26:06.560280 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-389f2918-221e-47bf-a976-79159beeea7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:26:06.676037 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 335/673] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:26:06 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:26:06.700171 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c2d303-7a87-448c-923c-c7cef4610f88 None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:06.895444 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c2d303-7a87-448c-923c-c7cef4610f88 None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:06.970170 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89fe4b8-af5f-4ed5-b241-611c64067e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:06.971336 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89fe4b8-af5f-4ed5-b241-611c64067e64 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:06.971850 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89fe4b8-af5f-4ed5-b241-611c64067e64 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:06.972362 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89fe4b8-af5f-4ed5-b241-611c64067e64 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:06.977831 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:06.995614 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89fe4b8-af5f-4ed5-b241-611c64067e64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:26:07.006130 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application [None req-d89fe4b8-af5f-4ed5-b241-611c64067e64 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 15:26:07.006130 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:26:07.006130 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:26:07.006130 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:26:07.006130 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:26:07.006130 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:26:07.006130 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:26:07.006130 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:26:07.006130 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:26:07.006130 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:26:07.006130 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:26:07.006130 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:26:07.006130 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:26:07.006130 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:26:07.006130 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:26:07.006130 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:26:07.007155 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:26:07.007155 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:26:07.007155 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:26:07.007155 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:26:07.007155 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:26:07.007155 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:26:07.007155 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:26:07.007155 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:26:07.007155 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:26:07.007155 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:26:07.007155 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:26:07.007155 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application with Lock( Jul 26 15:26:07.007155 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:26:07.007155 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:26:07.007155 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:26:07.007155 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:26:07.008076 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:26:07.008076 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:26:07.008076 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:26:07.008076 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:26:07.008076 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:26:07.008076 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:26:07.008076 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:26:07.008076 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:26:07.008076 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:26:07.008076 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:26:07.008076 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 15:26:07.008076 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:26:07.009306 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 339/674] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jul 26 15:26:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 15:26:07.016434 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389f2918-221e-47bf-a976-79159beeea7b None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:07.159624 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389f2918-221e-47bf-a976-79159beeea7b None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:07.171228 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:07.204529 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f9039f-380b-43b2-b8b4-f6900d9e592c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:07.205169 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f9039f-380b-43b2-b8b4-f6900d9e592c None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:07.205455 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f9039f-380b-43b2-b8b4-f6900d9e592c None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:07.205717 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f9039f-380b-43b2-b8b4-f6900d9e592c None admin] PATH_INFO: `/v3/roles` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:07.206434 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f9039f-380b-43b2-b8b4-f6900d9e592c None admin] RBAC: Adding query filter params (name=admin) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:26:07.206740 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f9039f-380b-43b2-b8b4-f6900d9e592c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:07.208522 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f9039f-380b-43b2-b8b4-f6900d9e592c None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:07.219191 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 336/675] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 15:26:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:26:07.228733 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89fe4b8-af5f-4ed5-b241-611c64067e64 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:07.433507 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89fe4b8-af5f-4ed5-b241-611c64067e64 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:07.505159 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c7326e-1863-4311-bc18-1638567af913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:07.506266 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c7326e-1863-4311-bc18-1638567af913 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:07.506764 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c7326e-1863-4311-bc18-1638567af913 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:07.507358 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c7326e-1863-4311-bc18-1638567af913 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:07.528979 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c7326e-1863-4311-bc18-1638567af913 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:07.531820 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c7326e-1863-4311-bc18-1638567af913 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:07.563894 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application [None req-b6c7326e-1863-4311-bc18-1638567af913 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:26:07.563894 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:26:07.563894 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:26:07.563894 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:26:07.563894 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:26:07.563894 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:26:07.563894 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:26:07.563894 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:26:07.563894 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:26:07.563894 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:26:07.563894 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:26:07.563894 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:26:07.563894 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:26:07.563894 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:26:07.563894 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:26:07.564864 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:26:07.564864 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:26:07.564864 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:26:07.564864 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:26:07.564864 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:26:07.564864 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:26:07.564864 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:26:07.564864 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:26:07.564864 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application with Lock( Jul 26 15:26:07.564864 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:26:07.564864 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:26:07.564864 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:26:07.564864 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:26:07.564864 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:26:07.564864 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:26:07.564864 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:26:07.564864 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:26:07.565747 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:26:07.565747 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:26:07.565747 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:26:07.565747 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:26:07.567186 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 340/676] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 15:26:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:26:07.576396 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f9039f-380b-43b2-b8b4-f6900d9e592c None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:07.783703 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f9039f-380b-43b2-b8b4-f6900d9e592c None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:07.854996 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db25f75-c276-4a49-97de-a5525c823f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:07.856594 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db25f75-c276-4a49-97de-a5525c823f9c None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:07.857383 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db25f75-c276-4a49-97de-a5525c823f9c None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:07.858164 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db25f75-c276-4a49-97de-a5525c823f9c None admin] PATH_INFO: `/v3/domains` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:07.859827 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db25f75-c276-4a49-97de-a5525c823f9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:26:07.860681 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db25f75-c276-4a49-97de-a5525c823f9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:07.863685 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db25f75-c276-4a49-97de-a5525c823f9c None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:07.887945 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 337/677] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 15:26:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:26:07.896424 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c7326e-1863-4311-bc18-1638567af913 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:08.003704 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:08.118406 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c7326e-1863-4311-bc18-1638567af913 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:08.192708 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aab4ea-962e-4d20-b317-4a3064680e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:08.193926 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aab4ea-962e-4d20-b317-4a3064680e95 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:08.194714 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aab4ea-962e-4d20-b317-4a3064680e95 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:08.195579 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aab4ea-962e-4d20-b317-4a3064680e95 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:08.211571 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aab4ea-962e-4d20-b317-4a3064680e95 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:08.214639 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aab4ea-962e-4d20-b317-4a3064680e95 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:08.239959 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application [None req-67aab4ea-962e-4d20-b317-4a3064680e95 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 15:26:08.239959 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:26:08.239959 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:26:08.239959 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:26:08.239959 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:26:08.239959 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:26:08.239959 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:26:08.239959 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:26:08.239959 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:26:08.239959 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:26:08.239959 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:26:08.239959 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:26:08.239959 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 15:26:08.239959 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 15:26:08.239959 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 15:26:08.239959 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 15:26:08.252415 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:26:08.252415 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:26:08.252415 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 15:26:08.252415 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:26:08.252415 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 15:26:08.252415 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:26:08.252415 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:26:08.252415 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:26:08.252415 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:26:08.252415 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:26:08.252415 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:26:08.252415 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application with Lock( Jul 26 15:26:08.252415 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:26:08.252415 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:26:08.252415 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:26:08.252415 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:26:08.252415 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:26:08.252415 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:26:08.254411 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:26:08.254411 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:26:08.254411 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 15:26:08.254411 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 15:26:08.254411 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 15:26:08.254411 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 15:26:08.254411 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 15:26:08.254411 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 15:26:08.254411 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 15:26:08.254411 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:26:08.254411 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 341/678] 10.222.0.18 () {56 vars in 1093 bytes} [Tue Jul 26 15:26:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:26:08.255697 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f057be1-7a09-416c-bb6a-4d92e40118df None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:08.255697 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f057be1-7a09-416c-bb6a-4d92e40118df None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:08.255697 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f057be1-7a09-416c-bb6a-4d92e40118df None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:08.255697 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 338/679] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:26:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:26:08.258257 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f057be1-7a09-416c-bb6a-4d92e40118df None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:08.260052 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14b3b21-2c8a-470a-99eb-c4860fd6bb51 None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:08.261094 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14b3b21-2c8a-470a-99eb-c4860fd6bb51 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:08.261666 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14b3b21-2c8a-470a-99eb-c4860fd6bb51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:08.295447 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-c14b3b21-2c8a-470a-99eb-c4860fd6bb51 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:26:08.297567 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-c14b3b21-2c8a-470a-99eb-c4860fd6bb51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:26:08.325156 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:08.466991 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 342/680] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:26:08 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:26:08.491063 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14b3b21-2c8a-470a-99eb-c4860fd6bb51 None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:08.492719 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f057be1-7a09-416c-bb6a-4d92e40118df None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:08.531963 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7810b0eb-9399-4979-9c6d-f3ab3275c9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:08.532969 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7810b0eb-9399-4979-9c6d-f3ab3275c9c0 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:08.533464 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7810b0eb-9399-4979-9c6d-f3ab3275c9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:08.533946 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7810b0eb-9399-4979-9c6d-f3ab3275c9c0 None admin] PATH_INFO: `/v3/users` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:08.534961 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7810b0eb-9399-4979-9c6d-f3ab3275c9c0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:26:08.535545 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7810b0eb-9399-4979-9c6d-f3ab3275c9c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:08.537245 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7810b0eb-9399-4979-9c6d-f3ab3275c9c0 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:08.557427 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 339/681] 10.222.0.18 () {56 vars in 1133 bytes} [Tue Jul 26 15:26:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:26:08.566584 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7810b0eb-9399-4979-9c6d-f3ab3275c9c0 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:08.576083 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:08.699975 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14b3b21-2c8a-470a-99eb-c4860fd6bb51 None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:08.728635 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:08.758989 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7810b0eb-9399-4979-9c6d-f3ab3275c9c0 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:08.770442 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a25b10-dec0-42cc-9bb9-4310900c0ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:08.771546 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a25b10-dec0-42cc-9bb9-4310900c0ef3 None admin] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:08.772041 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a25b10-dec0-42cc-9bb9-4310900c0ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:08.772520 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a25b10-dec0-42cc-9bb9-4310900c0ef3 None admin] PATH_INFO: `/v3/services` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:08.773878 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a25b10-dec0-42cc-9bb9-4310900c0ef3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:08.778346 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a25b10-dec0-42cc-9bb9-4310900c0ef3 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:08.827292 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d40895f-aacc-460e-8333-681f7007c7f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:08.828390 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d40895f-aacc-460e-8333-681f7007c7f1 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:08.828850 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d40895f-aacc-460e-8333-681f7007c7f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:08.829341 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d40895f-aacc-460e-8333-681f7007c7f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:08.850621 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d40895f-aacc-460e-8333-681f7007c7f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:08.853564 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d40895f-aacc-460e-8333-681f7007c7f1 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:08.883368 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 343/682] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Jul 26 15:26:08 2022] POST /identity/v3/services => generated 242 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:26:08.888352 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-0d40895f-aacc-460e-8333-681f7007c7f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:26:08.888352 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:26:08.888352 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:26:08.888352 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:26:08.888352 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:26:08.888352 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:26:08.888352 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:26:08.888352 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:26:08.888352 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:26:08.888352 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:26:08.888352 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:26:08.888352 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:26:08.888352 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:26:08.888352 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:26:08.888352 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:26:08.890855 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:26:08.890855 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:26:08.890855 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:26:08.890855 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:26:08.890855 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:26:08.890855 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:26:08.890855 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:26:08.890855 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:26:08.890855 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:26:08.890855 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:26:08.890855 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:26:08.890855 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:26:08.890855 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:26:08.890855 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:26:08.890855 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:26:08.890855 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:26:08.890855 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:26:08.892738 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:26:08.892738 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:26:08.892738 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:26:08.892738 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:26:08.896657 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 340/683] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 15:26:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:26:08.906251 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a25b10-dec0-42cc-9bb9-4310900c0ef3 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:08.958621 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b57061e-9e96-4761-bee5-5a92ea6b3a81 None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:08.959240 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b57061e-9e96-4761-bee5-5a92ea6b3a81 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:08.960089 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b57061e-9e96-4761-bee5-5a92ea6b3a81 None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:08.963331 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 341/684] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:26:08 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 15:26:08.970617 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4941fa45-f67f-43e6-bd27-8aea5c1e4244 None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:08.971026 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4941fa45-f67f-43e6-bd27-8aea5c1e4244 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:08.971473 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4941fa45-f67f-43e6-bd27-8aea5c1e4244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:09.012857 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-4941fa45-f67f-43e6-bd27-8aea5c1e4244 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:26:09.016007 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-4941fa45-f67f-43e6-bd27-8aea5c1e4244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:26:09.065709 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:09.078495 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a25b10-dec0-42cc-9bb9-4310900c0ef3 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:09.123429 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9428fb-5d3e-4de3-ba01-22495764c87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:09.124796 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9428fb-5d3e-4de3-ba01-22495764c87c None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:09.125544 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9428fb-5d3e-4de3-ba01-22495764c87c None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:09.126088 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9428fb-5d3e-4de3-ba01-22495764c87c None admin] PATH_INFO: `/v3/domains` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:09.127529 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9428fb-5d3e-4de3-ba01-22495764c87c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:26:09.128081 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9428fb-5d3e-4de3-ba01-22495764c87c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:09.129784 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9428fb-5d3e-4de3-ba01-22495764c87c None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:09.143958 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 344/685] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 15:26:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:26:09.153147 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9428fb-5d3e-4de3-ba01-22495764c87c None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:09.171318 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 342/686] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:26:08 2022] POST /identity/v3/auth/tokens => generated 994 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:26:09.207097 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4941fa45-f67f-43e6-bd27-8aea5c1e4244 None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:09.320450 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9428fb-5d3e-4de3-ba01-22495764c87c None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:09.372329 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:09.384258 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8586d43-84a2-4c04-8546-6f7d0faf3af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:09.385430 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8586d43-84a2-4c04-8546-6f7d0faf3af1 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:09.385928 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8586d43-84a2-4c04-8546-6f7d0faf3af1 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:09.386433 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8586d43-84a2-4c04-8546-6f7d0faf3af1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:09.400034 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8586d43-84a2-4c04-8546-6f7d0faf3af1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:09.403574 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8586d43-84a2-4c04-8546-6f7d0faf3af1 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:09.409194 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4941fa45-f67f-43e6-bd27-8aea5c1e4244 None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:09.428518 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application [None req-b8586d43-84a2-4c04-8546-6f7d0faf3af1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:26:09.428518 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:26:09.428518 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:26:09.428518 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:26:09.428518 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:26:09.428518 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:26:09.428518 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:26:09.428518 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:26:09.428518 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:26:09.428518 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:26:09.428518 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:26:09.428518 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:26:09.428518 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 15:26:09.428518 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 15:26:09.428518 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 15:26:09.430115 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 15:26:09.430115 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:26:09.430115 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:26:09.430115 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:26:09.430115 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:26:09.430115 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:26:09.430115 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:26:09.430115 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:26:09.430115 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application with Lock( Jul 26 15:26:09.430115 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:26:09.430115 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:26:09.430115 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:26:09.430115 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:26:09.430115 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:26:09.430115 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:26:09.430115 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:26:09.430115 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:26:09.431728 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 15:26:09.431728 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 15:26:09.431728 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 15:26:09.431728 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 15:26:09.431728 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 15:26:09.431728 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 15:26:09.431728 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:26:09.431728 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:26:09.431728 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 345/687] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 15:26:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:26:09.441279 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8586d43-84a2-4c04-8546-6f7d0faf3af1 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:09.462609 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:09.504145 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ee12f8-d96a-459f-95a6-5fb3f16ccae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:09.505776 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ee12f8-d96a-459f-95a6-5fb3f16ccae5 None admin] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:09.506424 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ee12f8-d96a-459f-95a6-5fb3f16ccae5 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:09.507457 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ee12f8-d96a-459f-95a6-5fb3f16ccae5 None admin] PATH_INFO: `/v3/services` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:09.508241 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ee12f8-d96a-459f-95a6-5fb3f16ccae5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:09.509689 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ee12f8-d96a-459f-95a6-5fb3f16ccae5 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:09.622834 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8586d43-84a2-4c04-8546-6f7d0faf3af1 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:09.641698 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 343/688] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Jul 26 15:26:09 2022] POST /identity/v3/services => generated 251 bytes in 436 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:26:09.692398 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f9dcfd-3b47-47ce-b4ba-7f6f472f49d2 None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:09.692876 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f9dcfd-3b47-47ce-b4ba-7f6f472f49d2 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:09.693347 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f9dcfd-3b47-47ce-b4ba-7f6f472f49d2 None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:09.703455 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 344/689] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:26:09 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 15:26:09.705713 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae44942-a766-40bc-9dac-f9540cf05ea9 None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:09.706185 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae44942-a766-40bc-9dac-f9540cf05ea9 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:09.706654 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae44942-a766-40bc-9dac-f9540cf05ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:09.721172 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9354be15-1db5-4603-a2a1-dd3333d23023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:09.722251 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9354be15-1db5-4603-a2a1-dd3333d23023 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:09.722693 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9354be15-1db5-4603-a2a1-dd3333d23023 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:09.727185 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9354be15-1db5-4603-a2a1-dd3333d23023 None admin] PATH_INFO: `/v3/projects` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:09.727185 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9354be15-1db5-4603-a2a1-dd3333d23023 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:26:09.727185 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9354be15-1db5-4603-a2a1-dd3333d23023 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:09.727710 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9354be15-1db5-4603-a2a1-dd3333d23023 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:09.740459 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-2ae44942-a766-40bc-9dac-f9540cf05ea9 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:26:09.742786 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-2ae44942-a766-40bc-9dac-f9540cf05ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:26:09.758556 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 346/690] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jul 26 15:26:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:26:09.761492 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9354be15-1db5-4603-a2a1-dd3333d23023 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:09.889367 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 345/691] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:26:09 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 15:26:09.897499 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:09.940928 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae44942-a766-40bc-9dac-f9540cf05ea9 None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:09.982556 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9354be15-1db5-4603-a2a1-dd3333d23023 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:10.052405 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13800d08-21f4-46e3-9d0d-89f853fee236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:10.054010 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13800d08-21f4-46e3-9d0d-89f853fee236 None admin] REQUEST_METHOD: `PUT` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:10.054785 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13800d08-21f4-46e3-9d0d-89f853fee236 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:10.055615 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13800d08-21f4-46e3-9d0d-89f853fee236 None admin] PATH_INFO: `/v3/projects/9178e468facc41d6a7d828dfcd5301b4/users/fbc5f2b36d3f45f1b3c8155e46c46fda/roles/2c659645e15c4204b1457556939397cb` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:10.060001 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13800d08-21f4-46e3-9d0d-89f853fee236 None admin] RBAC: Authorizing `identity:create_grant(project_id=9178e468facc41d6a7d828dfcd5301b4, user_id=fbc5f2b36d3f45f1b3c8155e46c46fda, role_id=2c659645e15c4204b1457556939397cb)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:10.063259 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13800d08-21f4-46e3-9d0d-89f853fee236 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:10.076012 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:10.122103 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae44942-a766-40bc-9dac-f9540cf05ea9 None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:10.147506 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 347/692] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jul 26 15:26:09 2022] PUT /identity/v3/projects/9178e468facc41d6a7d828dfcd5301b4/users/fbc5f2b36d3f45f1b3c8155e46c46fda/roles/2c659645e15c4204b1457556939397cb => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:26:10.194992 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86402835-e6d5-4023-96e5-1d7f81eb64e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:10.196216 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86402835-e6d5-4023-96e5-1d7f81eb64e8 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:10.196728 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86402835-e6d5-4023-96e5-1d7f81eb64e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:10.197296 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86402835-e6d5-4023-96e5-1d7f81eb64e8 None admin] PATH_INFO: `/v3/services/network` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:10.199330 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86402835-e6d5-4023-96e5-1d7f81eb64e8 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:10.202053 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86402835-e6d5-4023-96e5-1d7f81eb64e8 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:10.222555 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-86402835-e6d5-4023-96e5-1d7f81eb64e8 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 15:26:10.222555 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:26:10.222555 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 15:26:10.222555 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 15:26:10.222555 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 15:26:10.222555 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 15:26:10.222555 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 15:26:10.222555 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 15:26:10.222555 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 15:26:10.222555 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:26:10.222555 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 15:26:10.222555 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:26:10.222555 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:26:10.222555 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:26:10.222555 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:26:10.222555 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:26:10.222555 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:26:10.224430 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:26:10.224430 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:26:10.224430 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:26:10.224430 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:26:10.224430 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:26:10.224430 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:26:10.224430 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 15:26:10.224430 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 15:26:10.224430 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 15:26:10.224430 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 15:26:10.224430 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:26:10.224430 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:26:10.224430 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:26:10.224430 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:26:10.224430 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:26:10.224430 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:26:10.225900 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:26:10.225900 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:26:10.225900 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:26:10.225900 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:26:10.225900 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:26:10.225900 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:26:10.225900 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:26:10.225900 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:26:10.225900 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:26:10.225900 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:26:10.225900 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 15:26:10.225900 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 15:26:10.225900 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 15:26:10.225900 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:26:10.225900 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 346/693] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 15:26:09 2022] GET /identity/v3/services/network => generated 88 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:26:10.236982 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13800d08-21f4-46e3-9d0d-89f853fee236 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:10.392987 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13800d08-21f4-46e3-9d0d-89f853fee236 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:10.432899 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:10.440516 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bdfb61-f23b-4bc3-941d-6c3c83b1e0a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:10.441826 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bdfb61-f23b-4bc3-941d-6c3c83b1e0a2 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:10.442116 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bdfb61-f23b-4bc3-941d-6c3c83b1e0a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:10.442391 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bdfb61-f23b-4bc3-941d-6c3c83b1e0a2 None admin] PATH_INFO: `/v3/services` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:10.443103 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bdfb61-f23b-4bc3-941d-6c3c83b1e0a2 None admin] RBAC: Adding query filter params (name=network) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:26:10.443447 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bdfb61-f23b-4bc3-941d-6c3c83b1e0a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:10.444877 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bdfb61-f23b-4bc3-941d-6c3c83b1e0a2 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:10.452980 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 348/694] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Jul 26 15:26:10 2022] GET /identity/v3/services?name=network => generated 124 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:26:10.460047 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86402835-e6d5-4023-96e5-1d7f81eb64e8 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:10.666892 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86402835-e6d5-4023-96e5-1d7f81eb64e8 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:10.700207 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:10.719433 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4bcd55-0a13-43ec-a2ea-17eba634162f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:10.720566 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4bcd55-0a13-43ec-a2ea-17eba634162f None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:10.722334 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4bcd55-0a13-43ec-a2ea-17eba634162f None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:10.722856 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4bcd55-0a13-43ec-a2ea-17eba634162f None admin] PATH_INFO: `/v3/services` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:10.724279 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4bcd55-0a13-43ec-a2ea-17eba634162f None admin] RBAC: Adding query filter params (type=network) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:26:10.724834 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4bcd55-0a13-43ec-a2ea-17eba634162f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:10.727492 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4bcd55-0a13-43ec-a2ea-17eba634162f None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:10.740806 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 347/695] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Jul 26 15:26:10 2022] GET /identity/v3/services?type=network => generated 350 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:26:10.749917 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bdfb61-f23b-4bc3-941d-6c3c83b1e0a2 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:10.928501 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bdfb61-f23b-4bc3-941d-6c3c83b1e0a2 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:10.982804 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526c8aea-f553-4c4a-8ea7-83b1f517589f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:10.983888 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526c8aea-f553-4c4a-8ea7-83b1f517589f None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:10.984286 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526c8aea-f553-4c4a-8ea7-83b1f517589f None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:10.984777 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526c8aea-f553-4c4a-8ea7-83b1f517589f None admin] PATH_INFO: `/v3/endpoints` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:10.986107 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526c8aea-f553-4c4a-8ea7-83b1f517589f None admin] RBAC: Adding query filter params (interface=public, service_id=cdb5969ed71445b9ae9256696320c6c4, region_id=RegionOne) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:26:10.986587 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526c8aea-f553-4c4a-8ea7-83b1f517589f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:10.988834 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526c8aea-f553-4c4a-8ea7-83b1f517589f None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:11.002030 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 349/696] 10.222.0.18 () {56 vars in 1251 bytes} [Tue Jul 26 15:26:10 2022] GET /identity/v3/endpoints?service_id=cdb5969ed71445b9ae9256696320c6c4&interface=public®ion_id=RegionOne => generated 194 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:26:11.012412 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4bcd55-0a13-43ec-a2ea-17eba634162f None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:11.189364 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4bcd55-0a13-43ec-a2ea-17eba634162f None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:11.241879 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394be745-a2f2-4c67-8900-37b66ded5ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:11.242672 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394be745-a2f2-4c67-8900-37b66ded5ea4 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:11.243395 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394be745-a2f2-4c67-8900-37b66ded5ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:11.243816 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394be745-a2f2-4c67-8900-37b66ded5ea4 None admin] PATH_INFO: `/v3/services` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:11.245372 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394be745-a2f2-4c67-8900-37b66ded5ea4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:11.247778 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394be745-a2f2-4c67-8900-37b66ded5ea4 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:11.257406 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 348/697] 10.222.0.18 () {56 vars in 1087 bytes} [Tue Jul 26 15:26:11 2022] GET /identity/v3/services => generated 1002 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:26:12.610844 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b4f6f3-23d1-4218-94ad-096f94dcc680 None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:12.612033 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b4f6f3-23d1-4218-94ad-096f94dcc680 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:12.612556 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b4f6f3-23d1-4218-94ad-096f94dcc680 None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:12.614518 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 350/698] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:26:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 15:26:12.620561 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c57198-7574-4615-ac58-9cc203f0747b None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:12.621513 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c57198-7574-4615-ac58-9cc203f0747b None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:12.622047 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c57198-7574-4615-ac58-9cc203f0747b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:12.645036 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-98c57198-7574-4615-ac58-9cc203f0747b None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:26:12.647596 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-98c57198-7574-4615-ac58-9cc203f0747b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:26:12.737395 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:12.779585 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 349/699] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:26:12 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 15:26:12.813814 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b4f6f3-23d1-4218-94ad-096f94dcc680 None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:12.936002 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:12.946072 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b37605-cc9c-48ab-9c34-b3890687f4e3 None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:12.946569 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b37605-cc9c-48ab-9c34-b3890687f4e3 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:12.948157 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b37605-cc9c-48ab-9c34-b3890687f4e3 None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:12.951779 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 350/700] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:26:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 15:26:12.960928 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15810c8b-8258-4d1d-90be-a7f41f82beee None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:12.961888 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15810c8b-8258-4d1d-90be-a7f41f82beee None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:12.962605 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15810c8b-8258-4d1d-90be-a7f41f82beee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:12.995465 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b4f6f3-23d1-4218-94ad-096f94dcc680 None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:12.996412 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-15810c8b-8258-4d1d-90be-a7f41f82beee None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:26:13.000494 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-15810c8b-8258-4d1d-90be-a7f41f82beee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:26:13.036861 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3825af03-4514-470a-9caf-91d45ac42bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:13.037572 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3825af03-4514-470a-9caf-91d45ac42bdf None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:13.037865 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3825af03-4514-470a-9caf-91d45ac42bdf None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:13.038215 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3825af03-4514-470a-9caf-91d45ac42bdf None admin] PATH_INFO: `/v3/services/image` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:13.038877 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3825af03-4514-470a-9caf-91d45ac42bdf None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:13.040468 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3825af03-4514-470a-9caf-91d45ac42bdf None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:13.051641 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application [None req-3825af03-4514-470a-9caf-91d45ac42bdf None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 15:26:13.051641 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:26:13.051641 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 15:26:13.051641 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 15:26:13.051641 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 15:26:13.051641 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 15:26:13.051641 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 15:26:13.051641 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 15:26:13.051641 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 15:26:13.051641 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:26:13.051641 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 15:26:13.051641 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:26:13.051641 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:26:13.051641 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:26:13.051641 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:26:13.051641 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:26:13.051641 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:26:13.053652 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:26:13.053652 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:26:13.053652 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:26:13.053652 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:26:13.053652 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:26:13.053652 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:26:13.053652 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 15:26:13.053652 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 15:26:13.053652 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 15:26:13.053652 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 15:26:13.053652 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:26:13.053652 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:26:13.053652 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:26:13.053652 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:26:13.053652 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:26:13.053652 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:26:13.056721 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:26:13.056721 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application with Lock( Jul 26 15:26:13.056721 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:26:13.056721 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:26:13.056721 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:26:13.056721 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:26:13.056721 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:26:13.056721 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:26:13.056721 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:26:13.056721 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:26:13.056721 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 15:26:13.056721 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 15:26:13.056721 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 15:26:13.056721 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:26:13.056721 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 351/701] 10.222.0.18 () {56 vars in 1105 bytes} [Tue Jul 26 15:26:12 2022] GET /identity/v3/services/image => generated 86 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:26:13.065011 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3825af03-4514-470a-9caf-91d45ac42bdf None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:13.156697 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 351/702] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:26:12 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 15:26:13.182264 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15810c8b-8258-4d1d-90be-a7f41f82beee None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:13.268886 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3825af03-4514-470a-9caf-91d45ac42bdf None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:13.303935 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15810c8b-8258-4d1d-90be-a7f41f82beee None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:13.318878 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:13.330884 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:13.344936 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4e70f6-db3d-4953-a79b-0ad7d56df270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:13.346685 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e70f6-db3d-4953-a79b-0ad7d56df270 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:13.346685 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e70f6-db3d-4953-a79b-0ad7d56df270 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:13.346685 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e70f6-db3d-4953-a79b-0ad7d56df270 None admin] PATH_INFO: `/v3/services` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:13.347576 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4e70f6-db3d-4953-a79b-0ad7d56df270 None admin] RBAC: Adding query filter params (name=image) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:26:13.348064 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4e70f6-db3d-4953-a79b-0ad7d56df270 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:13.349488 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4e70f6-db3d-4953-a79b-0ad7d56df270 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:13.359891 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 352/703] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 15:26:13 2022] GET /identity/v3/services?name=image => generated 122 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:26:13.361493 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4e70f6-db3d-4953-a79b-0ad7d56df270 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:13.380219 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8683ab3f-ed3e-42e5-b960-0cad194aecbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:13.382645 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8683ab3f-ed3e-42e5-b960-0cad194aecbf None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:13.383431 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8683ab3f-ed3e-42e5-b960-0cad194aecbf None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:13.384370 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8683ab3f-ed3e-42e5-b960-0cad194aecbf None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:13.386799 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8683ab3f-ed3e-42e5-b960-0cad194aecbf None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:13.390393 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8683ab3f-ed3e-42e5-b960-0cad194aecbf None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:13.406255 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-8683ab3f-ed3e-42e5-b960-0cad194aecbf None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 15:26:13.406255 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:26:13.406255 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 15:26:13.406255 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 15:26:13.406255 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 15:26:13.406255 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 15:26:13.406255 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 15:26:13.406255 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 15:26:13.406255 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 15:26:13.406255 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:26:13.406255 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 15:26:13.406255 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:26:13.406255 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:26:13.406255 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:26:13.406255 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:26:13.406255 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:26:13.408389 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:26:13.408389 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:26:13.408389 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:26:13.408389 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:26:13.408389 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:26:13.408389 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:26:13.408389 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:26:13.408389 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 15:26:13.408389 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 15:26:13.408389 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 15:26:13.408389 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 15:26:13.408389 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:26:13.408389 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:26:13.408389 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:26:13.408389 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:26:13.408389 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:26:13.410224 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:26:13.410224 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:26:13.410224 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:26:13.410224 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:26:13.410224 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:26:13.410224 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:26:13.410224 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:26:13.410224 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:26:13.410224 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:26:13.410224 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:26:13.410224 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:26:13.410224 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 15:26:13.410224 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 15:26:13.410224 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 15:26:13.410224 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:26:13.414940 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 352/704] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Jul 26 15:26:13 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 15:26:13.416180 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8683ab3f-ed3e-42e5-b960-0cad194aecbf None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:13.549831 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4e70f6-db3d-4953-a79b-0ad7d56df270 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:13.599098 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8910f850-ac37-4e3c-99ab-f03b01450655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:13.599978 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8910f850-ac37-4e3c-99ab-f03b01450655 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:13.600379 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8910f850-ac37-4e3c-99ab-f03b01450655 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:13.600772 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8910f850-ac37-4e3c-99ab-f03b01450655 None admin] PATH_INFO: `/v3/services` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:13.601532 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8910f850-ac37-4e3c-99ab-f03b01450655 None admin] RBAC: Adding query filter params (type=image) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:26:13.601951 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8910f850-ac37-4e3c-99ab-f03b01450655 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:13.603581 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8910f850-ac37-4e3c-99ab-f03b01450655 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:13.614962 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 353/705] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 15:26:13 2022] GET /identity/v3/services?type=image => generated 350 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:26:13.616137 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8910f850-ac37-4e3c-99ab-f03b01450655 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:13.617501 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8683ab3f-ed3e-42e5-b960-0cad194aecbf None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:13.693464 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72afb4a-9447-4579-b38f-daec28127901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:13.695340 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72afb4a-9447-4579-b38f-daec28127901 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:13.695822 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72afb4a-9447-4579-b38f-daec28127901 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:13.696264 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72afb4a-9447-4579-b38f-daec28127901 None admin] PATH_INFO: `/v3/services` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:13.697933 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72afb4a-9447-4579-b38f-daec28127901 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:26:13.698463 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72afb4a-9447-4579-b38f-daec28127901 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:13.700503 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72afb4a-9447-4579-b38f-daec28127901 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:13.707671 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 353/706] 10.222.0.18 () {56 vars in 1124 bytes} [Tue Jul 26 15:26:13 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:26:13.711369 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:13.719028 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72afb4a-9447-4579-b38f-daec28127901 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:13.778016 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8910f850-ac37-4e3c-99ab-f03b01450655 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:13.798240 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:13.828161 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560bb390-2287-49fd-a459-212879eb2d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:13.829447 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560bb390-2287-49fd-a459-212879eb2d19 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:13.830332 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560bb390-2287-49fd-a459-212879eb2d19 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:13.831223 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560bb390-2287-49fd-a459-212879eb2d19 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:13.832734 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560bb390-2287-49fd-a459-212879eb2d19 None admin] RBAC: Adding query filter params (interface=public, service_id=0ee1613d6eaa466eb15ea6697fb5fdcb, region_id=RegionOne) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:26:13.833427 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560bb390-2287-49fd-a459-212879eb2d19 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:13.835744 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560bb390-2287-49fd-a459-212879eb2d19 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:13.851175 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 354/707] 10.222.0.18 () {56 vars in 1251 bytes} [Tue Jul 26 15:26:13 2022] GET /identity/v3/endpoints?service_id=0ee1613d6eaa466eb15ea6697fb5fdcb&interface=public®ion_id=RegionOne => generated 194 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:26:13.856725 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560bb390-2287-49fd-a459-212879eb2d19 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:13.884868 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72afb4a-9447-4579-b38f-daec28127901 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:13.951200 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e2d5c9-c687-41cf-b335-f83da89a842c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:13.952265 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e2d5c9-c687-41cf-b335-f83da89a842c None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:13.952669 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e2d5c9-c687-41cf-b335-f83da89a842c None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:13.953074 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e2d5c9-c687-41cf-b335-f83da89a842c None admin] PATH_INFO: `/v3/services` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:13.954106 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e2d5c9-c687-41cf-b335-f83da89a842c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:26:13.954560 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e2d5c9-c687-41cf-b335-f83da89a842c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:13.956706 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e2d5c9-c687-41cf-b335-f83da89a842c None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:13.972489 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 354/708] 10.222.0.18 () {56 vars in 1124 bytes} [Tue Jul 26 15:26:13 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:26:13.972489 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f32ee-ac4b-4e2e-96da-fc2e8ea82d2d None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:13.972489 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f32ee-ac4b-4e2e-96da-fc2e8ea82d2d None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:13.972489 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f32ee-ac4b-4e2e-96da-fc2e8ea82d2d None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:13.972489 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 355/709] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:26:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:26:13.973967 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16f32ee-ac4b-4e2e-96da-fc2e8ea82d2d None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:14.037318 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560bb390-2287-49fd-a459-212879eb2d19 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:14.059942 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:14.088819 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89273cbe-0fc0-4b88-a5f0-6ad460d407af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:14.089943 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89273cbe-0fc0-4b88-a5f0-6ad460d407af None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:14.090386 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89273cbe-0fc0-4b88-a5f0-6ad460d407af None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:14.090813 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89273cbe-0fc0-4b88-a5f0-6ad460d407af None admin] PATH_INFO: `/v3/services` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:14.092094 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89273cbe-0fc0-4b88-a5f0-6ad460d407af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:14.093989 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89273cbe-0fc0-4b88-a5f0-6ad460d407af None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:14.107200 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 355/710] 10.222.0.18 () {56 vars in 1087 bytes} [Tue Jul 26 15:26:13 2022] GET /identity/v3/services => generated 1002 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 15:26:14.107200 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1769796-930e-4731-8968-a70f7fe219dd None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:14.107200 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1769796-930e-4731-8968-a70f7fe219dd None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:14.107200 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1769796-930e-4731-8968-a70f7fe219dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:14.137862 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-a1769796-930e-4731-8968-a70f7fe219dd None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:26:14.140458 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-a1769796-930e-4731-8968-a70f7fe219dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:26:14.205967 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16f32ee-ac4b-4e2e-96da-fc2e8ea82d2d None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:14.209471 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:14.283680 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 356/711] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:26:14 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 15:26:14.285948 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb6b57d-5f9e-4947-9ce9-8de20fc5e257 None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:14.286503 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb6b57d-5f9e-4947-9ce9-8de20fc5e257 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:14.287045 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb6b57d-5f9e-4947-9ce9-8de20fc5e257 None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:14.289779 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 357/712] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:26:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:26:14.298863 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc01fcfc-8ae3-4f4b-a7bd-e57ad2b82688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:14.299373 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112c745a-2b68-4dd4-bc11-c8cc7b9cfce4 None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:14.299547 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112c745a-2b68-4dd4-bc11-c8cc7b9cfce4 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:14.300043 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112c745a-2b68-4dd4-bc11-c8cc7b9cfce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:14.301137 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc01fcfc-8ae3-4f4b-a7bd-e57ad2b82688 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:14.301886 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc01fcfc-8ae3-4f4b-a7bd-e57ad2b82688 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:14.302632 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc01fcfc-8ae3-4f4b-a7bd-e57ad2b82688 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:14.304409 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc01fcfc-8ae3-4f4b-a7bd-e57ad2b82688 None admin] RBAC: Adding query filter params (interface=public, service_id=7d452b0574204b0a8a52a2d1d99a02ce, region_id=RegionOne) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:26:14.305241 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc01fcfc-8ae3-4f4b-a7bd-e57ad2b82688 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:14.308493 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc01fcfc-8ae3-4f4b-a7bd-e57ad2b82688 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:14.331712 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 356/713] 10.222.0.18 () {56 vars in 1251 bytes} [Tue Jul 26 15:26:13 2022] GET /identity/v3/endpoints?service_id=7d452b0574204b0a8a52a2d1d99a02ce&interface=public®ion_id=RegionOne => generated 194 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:26:14.333152 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-112c745a-2b68-4dd4-bc11-c8cc7b9cfce4 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:26:14.334102 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc01fcfc-8ae3-4f4b-a7bd-e57ad2b82688 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:14.335416 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-112c745a-2b68-4dd4-bc11-c8cc7b9cfce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:26:14.462999 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 358/714] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:26:14 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 15:26:14.464429 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112c745a-2b68-4dd4-bc11-c8cc7b9cfce4 None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:14.524967 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc01fcfc-8ae3-4f4b-a7bd-e57ad2b82688 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:14.555481 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:14.578566 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e1f49f-d4c2-40ff-85a4-e0630befa11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:14.579703 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e1f49f-d4c2-40ff-85a4-e0630befa11e None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:14.580212 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e1f49f-d4c2-40ff-85a4-e0630befa11e None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:14.580699 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e1f49f-d4c2-40ff-85a4-e0630befa11e None admin] PATH_INFO: `/v3/services` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:14.581933 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e1f49f-d4c2-40ff-85a4-e0630befa11e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:14.584617 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e1f49f-d4c2-40ff-85a4-e0630befa11e None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:14.602493 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 357/715] 10.222.0.18 () {56 vars in 1087 bytes} [Tue Jul 26 15:26:14 2022] GET /identity/v3/services => generated 1002 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:26:14.602493 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e1f49f-d4c2-40ff-85a4-e0630befa11e None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:14.659309 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:14.698633 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112c745a-2b68-4dd4-bc11-c8cc7b9cfce4 None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:14.784177 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556dc58d-3a11-4de7-ba03-a582aef1f00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:14.785283 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556dc58d-3a11-4de7-ba03-a582aef1f00a None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:14.785770 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556dc58d-3a11-4de7-ba03-a582aef1f00a None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:14.786268 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556dc58d-3a11-4de7-ba03-a582aef1f00a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:14.806547 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e1f49f-d4c2-40ff-85a4-e0630befa11e None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:14.808649 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556dc58d-3a11-4de7-ba03-a582aef1f00a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:26:14.818873 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application [None req-556dc58d-3a11-4de7-ba03-a582aef1f00a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 15:26:14.818873 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:26:14.818873 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:26:14.818873 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:26:14.818873 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:26:14.818873 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:26:14.818873 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:26:14.818873 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:26:14.818873 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:26:14.818873 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:26:14.818873 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:26:14.818873 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:26:14.818873 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:26:14.818873 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:26:14.818873 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:26:14.818873 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:26:14.821210 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:26:14.821210 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:26:14.821210 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:26:14.821210 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:26:14.821210 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:26:14.821210 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:26:14.821210 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:26:14.821210 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:26:14.821210 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:26:14.821210 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:26:14.821210 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:26:14.821210 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application with Lock( Jul 26 15:26:14.821210 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:26:14.821210 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:26:14.821210 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:26:14.821210 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:26:14.823276 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:26:14.823276 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:26:14.823276 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:26:14.823276 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:26:14.823276 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:26:14.823276 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:26:14.823276 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:26:14.823276 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:26:14.823276 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:26:14.823276 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:26:14.823276 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 15:26:14.823276 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:26:14.823276 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 359/716] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jul 26 15:26:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:26:14.832636 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556dc58d-3a11-4de7-ba03-a582aef1f00a None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:14.872940 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7f1026-2bcc-4514-85a6-3c7701ed0874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:14.874119 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7f1026-2bcc-4514-85a6-3c7701ed0874 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:14.874618 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7f1026-2bcc-4514-85a6-3c7701ed0874 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:14.875204 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7f1026-2bcc-4514-85a6-3c7701ed0874 None admin] PATH_INFO: `/v3/services/network` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:14.876628 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7f1026-2bcc-4514-85a6-3c7701ed0874 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:14.879390 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7f1026-2bcc-4514-85a6-3c7701ed0874 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:14.898312 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-0a7f1026-2bcc-4514-85a6-3c7701ed0874 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 15:26:14.898312 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:26:14.898312 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 15:26:14.898312 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 15:26:14.898312 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 15:26:14.898312 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 15:26:14.898312 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 15:26:14.898312 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 15:26:14.898312 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 15:26:14.898312 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:26:14.898312 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 15:26:14.898312 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:26:14.898312 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:26:14.898312 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:26:14.898312 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:26:14.898312 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:26:14.898312 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:26:14.901734 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:26:14.901734 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:26:14.901734 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:26:14.901734 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:26:14.901734 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:26:14.901734 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:26:14.901734 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 15:26:14.901734 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 15:26:14.901734 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 15:26:14.901734 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 15:26:14.901734 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:26:14.901734 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:26:14.901734 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:26:14.901734 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:26:14.901734 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:26:14.901734 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:26:14.903628 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:26:14.903628 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:26:14.903628 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:26:14.903628 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:26:14.903628 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:26:14.903628 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:26:14.903628 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:26:14.903628 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:26:14.903628 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:26:14.903628 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:26:14.903628 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 15:26:14.903628 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 15:26:14.903628 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 15:26:14.903628 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:26:14.903628 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 358/717] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 15:26:14 2022] GET /identity/v3/services/network => generated 88 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:26:14.914513 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7f1026-2bcc-4514-85a6-3c7701ed0874 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:15.032742 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:15.041831 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7f1026-2bcc-4514-85a6-3c7701ed0874 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:15.053186 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:15.058928 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556dc58d-3a11-4de7-ba03-a582aef1f00a None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:15.108482 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b61b77f-d3fe-46eb-b869-5f9c8e482aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:15.109122 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b61b77f-d3fe-46eb-b869-5f9c8e482aac None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:15.109421 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b61b77f-d3fe-46eb-b869-5f9c8e482aac None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:15.109682 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b61b77f-d3fe-46eb-b869-5f9c8e482aac None admin] PATH_INFO: `/v3/services` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:15.110377 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b61b77f-d3fe-46eb-b869-5f9c8e482aac None admin] RBAC: Adding query filter params (name=network) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:26:15.110695 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b61b77f-d3fe-46eb-b869-5f9c8e482aac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:15.111675 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a5dfb8-8e54-42cb-91d2-233e65c5317e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:15.112158 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b61b77f-d3fe-46eb-b869-5f9c8e482aac None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:15.113034 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5dfb8-8e54-42cb-91d2-233e65c5317e None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:15.114037 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5dfb8-8e54-42cb-91d2-233e65c5317e None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:15.115570 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5dfb8-8e54-42cb-91d2-233e65c5317e None admin] PATH_INFO: `/v3/roles` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:15.117691 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a5dfb8-8e54-42cb-91d2-233e65c5317e None admin] RBAC: Adding query filter params (name=admin) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:26:15.118452 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 359/718] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Jul 26 15:26:14 2022] GET /identity/v3/services?name=network => generated 124 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:26:15.119181 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a5dfb8-8e54-42cb-91d2-233e65c5317e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:15.122156 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a5dfb8-8e54-42cb-91d2-233e65c5317e None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:15.124199 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b61b77f-d3fe-46eb-b869-5f9c8e482aac None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:15.149223 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 360/719] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 15:26:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:26:15.155573 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a5dfb8-8e54-42cb-91d2-233e65c5317e None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:15.288938 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a5dfb8-8e54-42cb-91d2-233e65c5317e None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:15.316985 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b61b77f-d3fe-46eb-b869-5f9c8e482aac None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:15.328694 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4743fe1b-ec10-4b1c-b73a-93f197fdc24b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:15.329614 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4743fe1b-ec10-4b1c-b73a-93f197fdc24b None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:15.330079 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4743fe1b-ec10-4b1c-b73a-93f197fdc24b None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:15.330525 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4743fe1b-ec10-4b1c-b73a-93f197fdc24b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:15.343743 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4743fe1b-ec10-4b1c-b73a-93f197fdc24b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:15.345490 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4743fe1b-ec10-4b1c-b73a-93f197fdc24b None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:15.362163 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application [None req-4743fe1b-ec10-4b1c-b73a-93f197fdc24b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:26:15.362163 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:26:15.362163 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:26:15.362163 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:26:15.362163 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:26:15.362163 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:26:15.362163 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:26:15.362163 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:26:15.362163 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:26:15.362163 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:26:15.362163 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:26:15.362163 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:26:15.362163 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:26:15.362163 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:26:15.362163 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:26:15.364096 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:26:15.364096 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:26:15.364096 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:26:15.364096 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:26:15.364096 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:26:15.364096 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:26:15.364096 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:26:15.364096 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:26:15.364096 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application with Lock( Jul 26 15:26:15.364096 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:26:15.364096 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:26:15.364096 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:26:15.364096 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:26:15.364096 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:26:15.364096 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:26:15.364096 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:26:15.364096 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:26:15.365975 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:26:15.365975 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:26:15.365975 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:26:15.365975 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:26:15.370575 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 361/720] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 15:26:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:26:15.371587 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4743fe1b-ec10-4b1c-b73a-93f197fdc24b None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:15.388583 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:15.390798 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41e125e-29f7-463a-bf98-a1c4f103fb1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:15.391901 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e125e-29f7-463a-bf98-a1c4f103fb1e None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:15.392386 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e125e-29f7-463a-bf98-a1c4f103fb1e None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:15.392873 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e125e-29f7-463a-bf98-a1c4f103fb1e None admin] PATH_INFO: `/v3/services` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:15.394207 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41e125e-29f7-463a-bf98-a1c4f103fb1e None admin] RBAC: Adding query filter params (type=network) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:26:15.394986 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41e125e-29f7-463a-bf98-a1c4f103fb1e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:15.397385 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41e125e-29f7-463a-bf98-a1c4f103fb1e None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:15.415795 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 360/721] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Jul 26 15:26:15 2022] GET /identity/v3/services?type=network => generated 350 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:26:15.418631 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41e125e-29f7-463a-bf98-a1c4f103fb1e None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:15.468360 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:15.486859 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4743fe1b-ec10-4b1c-b73a-93f197fdc24b None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:15.525314 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb6274d-02ee-4891-87e1-3695e5fca351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:15.526858 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6274d-02ee-4891-87e1-3695e5fca351 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:15.527397 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6274d-02ee-4891-87e1-3695e5fca351 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:15.527846 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6274d-02ee-4891-87e1-3695e5fca351 None admin] PATH_INFO: `/v3/domains` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:15.528740 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb6274d-02ee-4891-87e1-3695e5fca351 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:26:15.529226 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb6274d-02ee-4891-87e1-3695e5fca351 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:15.530789 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb6274d-02ee-4891-87e1-3695e5fca351 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:15.549499 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 362/722] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 15:26:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:26:15.550735 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb6274d-02ee-4891-87e1-3695e5fca351 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:15.623618 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41e125e-29f7-463a-bf98-a1c4f103fb1e None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:15.630762 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:15.665156 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb6274d-02ee-4891-87e1-3695e5fca351 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:15.706353 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23938a6b-a1f5-4f21-97a4-979ca2339836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:15.707406 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23938a6b-a1f5-4f21-97a4-979ca2339836 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:15.707406 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23938a6b-a1f5-4f21-97a4-979ca2339836 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:15.707690 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23938a6b-a1f5-4f21-97a4-979ca2339836 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:15.710149 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f614aa-63f6-4d0f-91e6-411b61281290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:15.711927 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f614aa-63f6-4d0f-91e6-411b61281290 None admin] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:15.714034 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f614aa-63f6-4d0f-91e6-411b61281290 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:15.714779 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f614aa-63f6-4d0f-91e6-411b61281290 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:15.716204 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f614aa-63f6-4d0f-91e6-411b61281290 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:15.716766 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23938a6b-a1f5-4f21-97a4-979ca2339836 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:15.718263 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23938a6b-a1f5-4f21-97a4-979ca2339836 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:15.719980 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f614aa-63f6-4d0f-91e6-411b61281290 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:15.732159 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application [None req-23938a6b-a1f5-4f21-97a4-979ca2339836 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 15:26:15.732159 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:26:15.732159 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:26:15.732159 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:26:15.732159 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:26:15.732159 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:26:15.732159 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:26:15.732159 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:26:15.732159 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:26:15.732159 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:26:15.732159 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:26:15.732159 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:26:15.732159 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 15:26:15.732159 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 15:26:15.732159 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 15:26:15.732159 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 15:26:15.734366 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:26:15.734366 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:26:15.734366 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 15:26:15.734366 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:26:15.734366 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 15:26:15.734366 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:26:15.734366 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:26:15.734366 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:26:15.734366 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:26:15.734366 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:26:15.734366 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:26:15.734366 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application with Lock( Jul 26 15:26:15.734366 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:26:15.734366 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:26:15.734366 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:26:15.734366 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:26:15.734366 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:26:15.734366 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:26:15.736663 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:26:15.736663 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:26:15.736663 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 15:26:15.736663 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 15:26:15.736663 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 15:26:15.736663 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 15:26:15.736663 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 15:26:15.736663 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 15:26:15.736663 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 15:26:15.736663 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:26:15.738247 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 363/723] 10.222.0.18 () {56 vars in 1093 bytes} [Tue Jul 26 15:26:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:26:15.739238 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23938a6b-a1f5-4f21-97a4-979ca2339836 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:15.839211 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 361/724] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Jul 26 15:26:15 2022] POST /identity/v3/endpoints => generated 327 bytes in 420 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:26:15.937341 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23938a6b-a1f5-4f21-97a4-979ca2339836 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:16.001003 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:16.021914 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68392be0-2729-4396-8e10-c28e3f39d9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:16.022870 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68392be0-2729-4396-8e10-c28e3f39d9c0 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:16.023426 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68392be0-2729-4396-8e10-c28e3f39d9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:16.023933 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68392be0-2729-4396-8e10-c28e3f39d9c0 None admin] PATH_INFO: `/v3/users` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:16.025465 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68392be0-2729-4396-8e10-c28e3f39d9c0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:26:16.026627 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68392be0-2729-4396-8e10-c28e3f39d9c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:16.029474 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68392be0-2729-4396-8e10-c28e3f39d9c0 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:16.062603 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 364/725] 10.222.0.18 () {56 vars in 1133 bytes} [Tue Jul 26 15:26:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:26:16.072466 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f614aa-63f6-4d0f-91e6-411b61281290 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:16.201645 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:16.242730 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f614aa-63f6-4d0f-91e6-411b61281290 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:16.306764 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbd79b6-6149-42b8-ab55-82eb923147d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:16.307878 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd79b6-6149-42b8-ab55-82eb923147d4 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:16.308389 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd79b6-6149-42b8-ab55-82eb923147d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:16.308887 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd79b6-6149-42b8-ab55-82eb923147d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:16.406913 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbd79b6-6149-42b8-ab55-82eb923147d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:16.408495 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbd79b6-6149-42b8-ab55-82eb923147d4 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:16.507582 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:16.537126 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 362/726] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 15:26:16 2022] GET /identity/v3/auth/tokens => generated 1247 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 15:26:16.544063 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68392be0-2729-4396-8e10-c28e3f39d9c0 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:16.721891 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68392be0-2729-4396-8e10-c28e3f39d9c0 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:16.768236 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bea2c1-d4f7-4636-af51-c46428538ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:16.768760 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bea2c1-d4f7-4636-af51-c46428538ed4 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:16.769036 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bea2c1-d4f7-4636-af51-c46428538ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:16.769320 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bea2c1-d4f7-4636-af51-c46428538ed4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:16.782807 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bea2c1-d4f7-4636-af51-c46428538ed4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:16.784383 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bea2c1-d4f7-4636-af51-c46428538ed4 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:16.803321 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application [None req-62bea2c1-d4f7-4636-af51-c46428538ed4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:26:16.803321 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:26:16.803321 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:26:16.803321 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:26:16.803321 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:26:16.803321 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:26:16.803321 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:26:16.803321 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:26:16.803321 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:26:16.803321 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:26:16.803321 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:26:16.803321 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:26:16.803321 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:26:16.803321 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:26:16.803321 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:26:16.804288 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:26:16.804288 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:26:16.804288 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:26:16.804288 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:26:16.804288 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:26:16.804288 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:26:16.804288 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:26:16.804288 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:26:16.804288 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application with Lock( Jul 26 15:26:16.804288 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:26:16.804288 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:26:16.804288 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:26:16.804288 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:26:16.804288 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:26:16.804288 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:26:16.804288 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:26:16.804288 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:26:16.805161 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:26:16.805161 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:26:16.805161 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:26:16.805161 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:26:16.805161 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 365/727] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 15:26:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 15:26:16.807211 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72425e7-e23e-4d00-8b98-30f447fe84af None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:16.807586 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72425e7-e23e-4d00-8b98-30f447fe84af None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:16.807876 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72425e7-e23e-4d00-8b98-30f447fe84af None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:16.809535 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 363/728] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:26:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:26:16.813935 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bea2c1-d4f7-4636-af51-c46428538ed4 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:16.815298 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ffd1f-a017-4c51-a238-4d0e9ab20969 None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:16.815599 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ffd1f-a017-4c51-a238-4d0e9ab20969 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:16.815882 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ffd1f-a017-4c51-a238-4d0e9ab20969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:16.835233 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-0f6ffd1f-a017-4c51-a238-4d0e9ab20969 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:26:16.836526 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-0f6ffd1f-a017-4c51-a238-4d0e9ab20969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:26:16.890334 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:16.923810 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 364/729] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:26:16 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 15:26:16.945831 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6ffd1f-a017-4c51-a238-4d0e9ab20969 None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:17.004803 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bea2c1-d4f7-4636-af51-c46428538ed4 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:17.044084 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c364e4f4-2ea0-4505-835f-210424555f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:17.044638 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c364e4f4-2ea0-4505-835f-210424555f44 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:17.045019 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c364e4f4-2ea0-4505-835f-210424555f44 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:17.045300 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c364e4f4-2ea0-4505-835f-210424555f44 None admin] PATH_INFO: `/v3/domains` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:17.046055 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c364e4f4-2ea0-4505-835f-210424555f44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:26:17.046380 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c364e4f4-2ea0-4505-835f-210424555f44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:17.047848 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c364e4f4-2ea0-4505-835f-210424555f44 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:17.062372 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 366/730] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 15:26:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:26:17.070262 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c364e4f4-2ea0-4505-835f-210424555f44 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:17.107156 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6ffd1f-a017-4c51-a238-4d0e9ab20969 None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:17.119044 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:17.147285 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4679d5-67c3-4e24-b61f-274549d69dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:17.148005 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4679d5-67c3-4e24-b61f-274549d69dc2 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:17.148141 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4679d5-67c3-4e24-b61f-274549d69dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:17.148627 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4679d5-67c3-4e24-b61f-274549d69dc2 None admin] PATH_INFO: `/v3/services/image` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:17.149083 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4679d5-67c3-4e24-b61f-274549d69dc2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:17.150557 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4679d5-67c3-4e24-b61f-274549d69dc2 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:17.161362 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-eb4679d5-67c3-4e24-b61f-274549d69dc2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 15:26:17.161362 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:26:17.161362 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 15:26:17.161362 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 15:26:17.161362 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 15:26:17.161362 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 15:26:17.161362 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 15:26:17.161362 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 15:26:17.161362 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 15:26:17.161362 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:26:17.161362 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 15:26:17.161362 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:26:17.161362 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:26:17.161362 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:26:17.161362 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:26:17.161362 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:26:17.161362 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:26:17.163535 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:26:17.163535 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:26:17.163535 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:26:17.163535 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:26:17.163535 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:26:17.163535 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:26:17.163535 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 15:26:17.163535 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 15:26:17.163535 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 15:26:17.163535 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 15:26:17.163535 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:26:17.163535 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:26:17.163535 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:26:17.163535 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:26:17.163535 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:26:17.163535 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:26:17.165354 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:26:17.165354 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:26:17.165354 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:26:17.165354 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:26:17.165354 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:26:17.165354 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:26:17.165354 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:26:17.165354 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:26:17.165354 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:26:17.165354 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:26:17.165354 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 15:26:17.165354 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 15:26:17.165354 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 15:26:17.165354 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:26:17.168740 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 365/731] 10.222.0.18 () {56 vars in 1105 bytes} [Tue Jul 26 15:26:16 2022] GET /identity/v3/services/image => generated 86 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 15:26:17.169768 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4679d5-67c3-4e24-b61f-274549d69dc2 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:17.223488 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:17.228337 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c364e4f4-2ea0-4505-835f-210424555f44 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:17.286223 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600d3568-7df0-4321-9f5d-057f5512c09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:17.287303 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600d3568-7df0-4321-9f5d-057f5512c09e None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:17.287732 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600d3568-7df0-4321-9f5d-057f5512c09e None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:17.288245 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600d3568-7df0-4321-9f5d-057f5512c09e None admin] PATH_INFO: `/v3/projects/service` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:17.297426 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600d3568-7df0-4321-9f5d-057f5512c09e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:17.299464 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600d3568-7df0-4321-9f5d-057f5512c09e None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:17.317758 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application [None req-600d3568-7df0-4321-9f5d-057f5512c09e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:26:17.317758 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:26:17.317758 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:26:17.317758 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:26:17.317758 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:26:17.317758 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:26:17.317758 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:26:17.317758 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:26:17.317758 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:26:17.317758 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:26:17.317758 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:26:17.317758 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:26:17.317758 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 15:26:17.317758 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 15:26:17.317758 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 15:26:17.318850 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 15:26:17.318850 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:26:17.318850 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:26:17.318850 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:26:17.318850 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:26:17.318850 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:26:17.318850 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:26:17.318850 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:26:17.318850 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application with Lock( Jul 26 15:26:17.318850 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:26:17.318850 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:26:17.318850 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:26:17.318850 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:26:17.318850 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:26:17.318850 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:26:17.318850 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:26:17.318850 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:26:17.319985 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 15:26:17.319985 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 15:26:17.319985 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 15:26:17.319985 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 15:26:17.319985 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 15:26:17.319985 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 15:26:17.319985 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:26:17.319985 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:26:17.323168 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 367/732] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 15:26:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 15:26:17.328917 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600d3568-7df0-4321-9f5d-057f5512c09e None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:17.349287 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4679d5-67c3-4e24-b61f-274549d69dc2 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:17.390845 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d63e0c-d4d4-4acd-b582-0e9b2f5aff97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:17.391527 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d63e0c-d4d4-4acd-b582-0e9b2f5aff97 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:17.392042 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d63e0c-d4d4-4acd-b582-0e9b2f5aff97 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:17.392454 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d63e0c-d4d4-4acd-b582-0e9b2f5aff97 None admin] PATH_INFO: `/v3/services` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:17.393252 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d63e0c-d4d4-4acd-b582-0e9b2f5aff97 None admin] RBAC: Adding query filter params (name=image) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:26:17.393570 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d63e0c-d4d4-4acd-b582-0e9b2f5aff97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:17.395116 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d63e0c-d4d4-4acd-b582-0e9b2f5aff97 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:17.406298 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 366/733] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 15:26:17 2022] GET /identity/v3/services?name=image => generated 122 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:26:17.407285 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d63e0c-d4d4-4acd-b582-0e9b2f5aff97 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:17.468993 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:17.473073 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600d3568-7df0-4321-9f5d-057f5512c09e None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:17.518592 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e57dc6-3def-4b8e-8da2-bc79af7d5a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:17.519472 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e57dc6-3def-4b8e-8da2-bc79af7d5a9b None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:17.519858 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e57dc6-3def-4b8e-8da2-bc79af7d5a9b None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:17.520488 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e57dc6-3def-4b8e-8da2-bc79af7d5a9b None admin] PATH_INFO: `/v3/projects` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:17.521225 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e57dc6-3def-4b8e-8da2-bc79af7d5a9b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:26:17.521634 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e57dc6-3def-4b8e-8da2-bc79af7d5a9b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:17.523394 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e57dc6-3def-4b8e-8da2-bc79af7d5a9b None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:17.542760 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 368/734] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jul 26 15:26:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:26:17.552583 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e57dc6-3def-4b8e-8da2-bc79af7d5a9b None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:17.583827 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:17.590001 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d63e0c-d4d4-4acd-b582-0e9b2f5aff97 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:17.647566 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304241c6-24f2-43f0-9334-a12cbcd7d5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:17.648564 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304241c6-24f2-43f0-9334-a12cbcd7d5d5 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:17.649023 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304241c6-24f2-43f0-9334-a12cbcd7d5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:17.649450 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304241c6-24f2-43f0-9334-a12cbcd7d5d5 None admin] PATH_INFO: `/v3/services` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:17.651042 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304241c6-24f2-43f0-9334-a12cbcd7d5d5 None admin] RBAC: Adding query filter params (type=image) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:26:17.651587 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304241c6-24f2-43f0-9334-a12cbcd7d5d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:17.654215 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304241c6-24f2-43f0-9334-a12cbcd7d5d5 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:17.668703 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 367/735] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 15:26:17 2022] GET /identity/v3/services?type=image => generated 350 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:26:17.670609 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304241c6-24f2-43f0-9334-a12cbcd7d5d5 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:17.727863 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e57dc6-3def-4b8e-8da2-bc79af7d5a9b None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:17.788441 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7931328-77bf-439f-be81-3e32ef20cb76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:17.789078 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7931328-77bf-439f-be81-3e32ef20cb76 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:17.789362 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7931328-77bf-439f-be81-3e32ef20cb76 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:17.789639 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7931328-77bf-439f-be81-3e32ef20cb76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:17.790456 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7931328-77bf-439f-be81-3e32ef20cb76 None admin] RBAC: Adding query filter params (role.id=2c659645e15c4204b1457556939397cb, scope.project.id=9178e468facc41d6a7d828dfcd5301b4, user.id=fbc5f2b36d3f45f1b3c8155e46c46fda) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:26:17.790769 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7931328-77bf-439f-be81-3e32ef20cb76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:17.792357 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7931328-77bf-439f-be81-3e32ef20cb76 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:17.806987 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 369/736] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 26 15:26:17 2022] GET /identity/v3/role_assignments?user.id=fbc5f2b36d3f45f1b3c8155e46c46fda&scope.project.id=9178e468facc41d6a7d828dfcd5301b4&role.id=2c659645e15c4204b1457556939397cb => generated 608 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:26:17.849634 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:17.853384 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304241c6-24f2-43f0-9334-a12cbcd7d5d5 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:17.895617 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349740b1-6e46-493e-8ddb-a4603f26ac87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:17.896256 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349740b1-6e46-493e-8ddb-a4603f26ac87 None admin] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:17.896537 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349740b1-6e46-493e-8ddb-a4603f26ac87 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:17.896817 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349740b1-6e46-493e-8ddb-a4603f26ac87 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:17.897547 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349740b1-6e46-493e-8ddb-a4603f26ac87 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:17.898984 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349740b1-6e46-493e-8ddb-a4603f26ac87 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:17.979245 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 368/737] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Jul 26 15:26:17 2022] POST /identity/v3/endpoints => generated 327 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:26:18.264472 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b171673-4636-4b1f-a3b1-9b546c77d4c6 None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:18.264987 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b171673-4636-4b1f-a3b1-9b546c77d4c6 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:18.265486 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b171673-4636-4b1f-a3b1-9b546c77d4c6 None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:18.268035 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 370/738] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:26:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:26:18.273817 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bf1bf9-0038-4432-9435-83df131209cd None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:18.274153 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bf1bf9-0038-4432-9435-83df131209cd None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:18.274397 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bf1bf9-0038-4432-9435-83df131209cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:18.302359 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-d7bf1bf9-0038-4432-9435-83df131209cd None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:26:18.304634 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-d7bf1bf9-0038-4432-9435-83df131209cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:26:18.455726 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 369/739] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:26:18 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 15:26:18.499672 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b171673-4636-4b1f-a3b1-9b546c77d4c6 None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:18.656239 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:18.691887 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b171673-4636-4b1f-a3b1-9b546c77d4c6 None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:18.757006 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f963f7-8b67-4cde-819b-14d646604ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:18.758096 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f963f7-8b67-4cde-819b-14d646604ecc None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:18.758551 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f963f7-8b67-4cde-819b-14d646604ecc None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:18.759012 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f963f7-8b67-4cde-819b-14d646604ecc None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:18.760851 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f963f7-8b67-4cde-819b-14d646604ecc None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:18.763118 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f963f7-8b67-4cde-819b-14d646604ecc None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:18.781592 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application [None req-64f963f7-8b67-4cde-819b-14d646604ecc None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 15:26:18.781592 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:26:18.781592 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 15:26:18.781592 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 15:26:18.781592 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 15:26:18.781592 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 15:26:18.781592 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 15:26:18.781592 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 15:26:18.781592 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 15:26:18.781592 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:26:18.781592 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 15:26:18.781592 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:26:18.781592 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:26:18.781592 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:26:18.781592 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:26:18.781592 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:26:18.782591 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:26:18.782591 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:26:18.782591 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:26:18.782591 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:26:18.782591 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:26:18.782591 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:26:18.782591 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:26:18.782591 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 15:26:18.782591 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 15:26:18.782591 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 15:26:18.782591 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 15:26:18.782591 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:26:18.782591 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:26:18.782591 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:26:18.782591 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:26:18.782591 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:26:18.783545 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:26:18.783545 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:26:18.783545 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application with Lock( Jul 26 15:26:18.783545 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:26:18.783545 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:26:18.783545 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:26:18.783545 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:26:18.783545 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:26:18.783545 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:26:18.783545 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:26:18.783545 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:26:18.783545 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 15:26:18.783545 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 15:26:18.783545 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 15:26:18.783545 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:26:18.784341 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 371/740] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Jul 26 15:26:18 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 15:26:18.794596 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bf1bf9-0038-4432-9435-83df131209cd None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:18.958986 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:18.999231 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bf1bf9-0038-4432-9435-83df131209cd None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:19.074213 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e25a997-14fe-457d-aaf8-c11eeddb9af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:19.075285 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25a997-14fe-457d-aaf8-c11eeddb9af1 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:19.075780 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25a997-14fe-457d-aaf8-c11eeddb9af1 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:19.076262 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25a997-14fe-457d-aaf8-c11eeddb9af1 None admin] PATH_INFO: `/v3/services` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:19.077644 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e25a997-14fe-457d-aaf8-c11eeddb9af1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:26:19.078187 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e25a997-14fe-457d-aaf8-c11eeddb9af1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:19.080805 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e25a997-14fe-457d-aaf8-c11eeddb9af1 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:19.095432 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 370/741] 10.222.0.18 () {56 vars in 1124 bytes} [Tue Jul 26 15:26:18 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:26:19.100641 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f963f7-8b67-4cde-819b-14d646604ecc None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:19.303526 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f963f7-8b67-4cde-819b-14d646604ecc None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:19.370534 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e69edf-7d03-4df7-a2f6-4d098e0fd6f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:19.371609 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e69edf-7d03-4df7-a2f6-4d098e0fd6f6 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:19.372079 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e69edf-7d03-4df7-a2f6-4d098e0fd6f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:19.372531 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e69edf-7d03-4df7-a2f6-4d098e0fd6f6 None admin] PATH_INFO: `/v3/services` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:19.373679 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e69edf-7d03-4df7-a2f6-4d098e0fd6f6 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:26:19.374201 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e69edf-7d03-4df7-a2f6-4d098e0fd6f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:19.376809 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e69edf-7d03-4df7-a2f6-4d098e0fd6f6 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:19.391230 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 372/742] 10.222.0.18 () {56 vars in 1124 bytes} [Tue Jul 26 15:26:19 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:26:19.396830 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e25a997-14fe-457d-aaf8-c11eeddb9af1 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:19.542243 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e25a997-14fe-457d-aaf8-c11eeddb9af1 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:19.608265 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a16ab-42c4-46df-8aa6-5f92aa528615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:19.608265 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a16ab-42c4-46df-8aa6-5f92aa528615 None admin] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:19.608265 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a16ab-42c4-46df-8aa6-5f92aa528615 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:19.608265 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a16ab-42c4-46df-8aa6-5f92aa528615 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:19.608731 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3a16ab-42c4-46df-8aa6-5f92aa528615 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:19.610817 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3a16ab-42c4-46df-8aa6-5f92aa528615 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:19.694375 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 371/743] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Jul 26 15:26:19 2022] POST /identity/v3/endpoints => generated 346 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:26:20.281861 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d6c67-6d38-409d-9c37-145ede718813 None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:20.282458 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d6c67-6d38-409d-9c37-145ede718813 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:20.282458 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d6c67-6d38-409d-9c37-145ede718813 None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:20.284031 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 373/744] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:26:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 15:26:20.289557 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b07e782-45fc-455b-8cea-001fcb7d6c90 None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:20.290090 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b07e782-45fc-455b-8cea-001fcb7d6c90 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:20.290090 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b07e782-45fc-455b-8cea-001fcb7d6c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:20.297136 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:20.313665 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-9b07e782-45fc-455b-8cea-001fcb7d6c90 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:26:20.314884 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-9b07e782-45fc-455b-8cea-001fcb7d6c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:26:20.407181 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 372/745] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:26:20 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 15:26:20.430344 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62d6c67-6d38-409d-9c37-145ede718813 None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:20.453528 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:20.598219 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62d6c67-6d38-409d-9c37-145ede718813 None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:20.653493 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1a2580-3d71-4f7b-839b-ddbcfa912549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:20.654322 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a2580-3d71-4f7b-839b-ddbcfa912549 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:20.654719 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a2580-3d71-4f7b-839b-ddbcfa912549 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:20.655048 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a2580-3d71-4f7b-839b-ddbcfa912549 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:20.656083 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1a2580-3d71-4f7b-839b-ddbcfa912549 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:20.658059 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1a2580-3d71-4f7b-839b-ddbcfa912549 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:20.671005 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application [None req-fd1a2580-3d71-4f7b-839b-ddbcfa912549 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 15:26:20.671005 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:26:20.671005 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 15:26:20.671005 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 15:26:20.671005 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 15:26:20.671005 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 15:26:20.671005 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 15:26:20.671005 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 15:26:20.671005 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 15:26:20.671005 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:26:20.671005 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 15:26:20.671005 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:26:20.671005 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:26:20.671005 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:26:20.671005 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:26:20.671005 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:26:20.677817 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:26:20.677817 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:26:20.677817 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:26:20.677817 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:26:20.677817 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:26:20.677817 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:26:20.677817 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:26:20.677817 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 15:26:20.677817 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 15:26:20.677817 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 15:26:20.677817 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 15:26:20.677817 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:26:20.677817 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:26:20.677817 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:26:20.677817 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:26:20.677817 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:26:20.680160 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:26:20.680160 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:26:20.680160 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application with Lock( Jul 26 15:26:20.680160 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:26:20.680160 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:26:20.680160 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:26:20.680160 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:26:20.680160 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:26:20.680160 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:26:20.680160 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:26:20.680160 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:26:20.680160 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 15:26:20.680160 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 15:26:20.680160 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 15:26:20.680160 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:26:20.680160 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 374/746] 10.222.0.18 () {56 vars in 1132 bytes} [Tue Jul 26 15:26:20 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 15:26:20.683994 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b07e782-45fc-455b-8cea-001fcb7d6c90 None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:20.795952 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6180050b-83d0-4675-9cb8-aeb5786769ae None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:20.796211 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6180050b-83d0-4675-9cb8-aeb5786769ae None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:20.796554 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6180050b-83d0-4675-9cb8-aeb5786769ae None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:20.798825 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 375/747] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:26:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:26:20.804455 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc75e74-17cb-4194-860d-ad2763c6e72e None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:20.804730 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc75e74-17cb-4194-860d-ad2763c6e72e None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:20.805027 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc75e74-17cb-4194-860d-ad2763c6e72e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:20.825504 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-efc75e74-17cb-4194-860d-ad2763c6e72e None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:26:20.826870 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-efc75e74-17cb-4194-860d-ad2763c6e72e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:26:20.843584 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b07e782-45fc-455b-8cea-001fcb7d6c90 None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:20.875270 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:20.884644 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9674cf-c4aa-49b2-9d9e-8c9b921a7b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:20.885795 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9674cf-c4aa-49b2-9d9e-8c9b921a7b29 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:20.886083 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9674cf-c4aa-49b2-9d9e-8c9b921a7b29 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:20.886357 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9674cf-c4aa-49b2-9d9e-8c9b921a7b29 None admin] PATH_INFO: `/v3/services` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:20.887045 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9674cf-c4aa-49b2-9d9e-8c9b921a7b29 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:26:20.887383 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9674cf-c4aa-49b2-9d9e-8c9b921a7b29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:20.888801 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9674cf-c4aa-49b2-9d9e-8c9b921a7b29 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:20.893862 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 373/748] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Jul 26 15:26:20 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:26:20.899695 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9674cf-c4aa-49b2-9d9e-8c9b921a7b29 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:20.930006 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 376/749] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:26:20 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 15:26:20.954381 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc75e74-17cb-4194-860d-ad2763c6e72e None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:20.957840 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:21.050852 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9674cf-c4aa-49b2-9d9e-8c9b921a7b29 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:21.086682 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc75e74-17cb-4194-860d-ad2763c6e72e None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:21.102051 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c0795d-7e23-4487-a90c-e82ff16d528e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:21.102684 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0795d-7e23-4487-a90c-e82ff16d528e None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:21.102968 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0795d-7e23-4487-a90c-e82ff16d528e None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:21.103278 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0795d-7e23-4487-a90c-e82ff16d528e None admin] PATH_INFO: `/v3/services` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:21.104593 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c0795d-7e23-4487-a90c-e82ff16d528e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:26:21.104914 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c0795d-7e23-4487-a90c-e82ff16d528e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:21.106303 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c0795d-7e23-4487-a90c-e82ff16d528e None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:21.111304 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 374/750] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Jul 26 15:26:20 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:26:21.141965 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a8ef31-7a13-4967-b3ba-2512d8438864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:21.142945 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a8ef31-7a13-4967-b3ba-2512d8438864 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:21.143481 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a8ef31-7a13-4967-b3ba-2512d8438864 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:21.143960 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a8ef31-7a13-4967-b3ba-2512d8438864 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:21.250512 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a8ef31-7a13-4967-b3ba-2512d8438864 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:21.252064 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a8ef31-7a13-4967-b3ba-2512d8438864 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:21.255558 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:21.367245 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 377/751] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 15:26:20 2022] GET /identity/v3/auth/tokens => generated 1396 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 26 15:26:21.373286 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c0795d-7e23-4487-a90c-e82ff16d528e None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:21.468519 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:21.528826 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c0795d-7e23-4487-a90c-e82ff16d528e None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:21.576526 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52fdac9-b288-4f16-9326-fccc9804a699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:21.577647 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52fdac9-b288-4f16-9326-fccc9804a699 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:21.578165 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52fdac9-b288-4f16-9326-fccc9804a699 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:21.578616 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52fdac9-b288-4f16-9326-fccc9804a699 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:21.598030 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52fdac9-b288-4f16-9326-fccc9804a699 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:21.600966 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52fdac9-b288-4f16-9326-fccc9804a699 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:21.630467 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-c52fdac9-b288-4f16-9326-fccc9804a699 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:26:21.630467 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:26:21.630467 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:26:21.630467 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:26:21.630467 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:26:21.630467 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:26:21.630467 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:26:21.630467 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:26:21.630467 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:26:21.630467 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:26:21.630467 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:26:21.630467 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:26:21.630467 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:26:21.630467 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:26:21.630467 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:26:21.632217 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:26:21.632217 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:26:21.632217 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:26:21.632217 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:26:21.632217 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:26:21.632217 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:26:21.632217 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:26:21.632217 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:26:21.632217 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:26:21.632217 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:26:21.632217 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:26:21.632217 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:26:21.632217 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:26:21.632217 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:26:21.632217 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:26:21.632217 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:26:21.632217 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:26:21.633372 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:26:21.633372 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:26:21.633372 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:26:21.633372 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:26:21.635727 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 375/752] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 15:26:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 15:26:21.642189 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a8ef31-7a13-4967-b3ba-2512d8438864 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:21.793099 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a8ef31-7a13-4967-b3ba-2512d8438864 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:21.795756 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:21.835317 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc89e5d-f407-4849-87e7-6206df41fca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:21.835959 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc89e5d-f407-4849-87e7-6206df41fca1 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:21.836250 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc89e5d-f407-4849-87e7-6206df41fca1 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:21.836534 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc89e5d-f407-4849-87e7-6206df41fca1 None admin] PATH_INFO: `/v3/domains` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:21.837264 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc89e5d-f407-4849-87e7-6206df41fca1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:26:21.837574 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc89e5d-f407-4849-87e7-6206df41fca1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:21.839774 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc89e5d-f407-4849-87e7-6206df41fca1 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:21.853582 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 378/753] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 15:26:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:26:22.172551 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c2690-602a-4727-9ae0-a3048eeafe57 None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:22.172751 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c2690-602a-4727-9ae0-a3048eeafe57 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:22.173070 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c2690-602a-4727-9ae0-a3048eeafe57 None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:22.174658 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 376/754] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:26:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:26:22.180367 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3238e15-7077-4d72-ac4f-a1ce75f29780 None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:22.180660 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3238e15-7077-4d72-ac4f-a1ce75f29780 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:22.180938 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3238e15-7077-4d72-ac4f-a1ce75f29780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:22.202202 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-b3238e15-7077-4d72-ac4f-a1ce75f29780 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:26:22.204254 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-b3238e15-7077-4d72-ac4f-a1ce75f29780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:26:22.301471 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 379/755] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:26:22 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 15:26:22.325689 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1c2690-602a-4727-9ae0-a3048eeafe57 None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:22.455293 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1c2690-602a-4727-9ae0-a3048eeafe57 None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:22.467453 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:22.498007 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549dc8de-80ad-43f0-bf36-bffb31982435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:22.498789 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549dc8de-80ad-43f0-bf36-bffb31982435 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:22.499193 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549dc8de-80ad-43f0-bf36-bffb31982435 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:22.499587 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549dc8de-80ad-43f0-bf36-bffb31982435 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:22.500316 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549dc8de-80ad-43f0-bf36-bffb31982435 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:22.501894 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549dc8de-80ad-43f0-bf36-bffb31982435 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:22.512866 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-549dc8de-80ad-43f0-bf36-bffb31982435 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 15:26:22.512866 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:26:22.512866 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 15:26:22.512866 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 15:26:22.512866 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 15:26:22.512866 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 15:26:22.512866 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 15:26:22.512866 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 15:26:22.512866 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 15:26:22.512866 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:26:22.512866 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 15:26:22.512866 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:26:22.512866 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:26:22.512866 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:26:22.512866 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:26:22.512866 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:26:22.512866 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:26:22.515055 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:26:22.515055 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:26:22.515055 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:26:22.515055 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:26:22.515055 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:26:22.515055 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:26:22.515055 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 15:26:22.515055 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 15:26:22.515055 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 15:26:22.515055 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 15:26:22.515055 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:26:22.515055 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:26:22.515055 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:26:22.515055 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:26:22.515055 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:26:22.515055 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:26:22.516745 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:26:22.516745 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:26:22.516745 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:26:22.516745 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:26:22.516745 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:26:22.516745 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:26:22.516745 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:26:22.516745 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:26:22.516745 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:26:22.516745 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:26:22.516745 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 15:26:22.516745 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 15:26:22.516745 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 15:26:22.516745 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:26:22.516745 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 377/756] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jul 26 15:26:22 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 15:26:22.523221 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3238e15-7077-4d72-ac4f-a1ce75f29780 None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:22.637965 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:22.645870 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3238e15-7077-4d72-ac4f-a1ce75f29780 None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:22.690071 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e060011-b012-48a2-bb22-f06504381f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:22.690859 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e060011-b012-48a2-bb22-f06504381f90 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:22.691286 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e060011-b012-48a2-bb22-f06504381f90 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:22.691657 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e060011-b012-48a2-bb22-f06504381f90 None admin] PATH_INFO: `/v3/services` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:22.692451 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e060011-b012-48a2-bb22-f06504381f90 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:26:22.692863 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e060011-b012-48a2-bb22-f06504381f90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:22.694366 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e060011-b012-48a2-bb22-f06504381f90 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:22.700857 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 380/757] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jul 26 15:26:22 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:26:22.710900 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549dc8de-80ad-43f0-bf36-bffb31982435 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:22.904245 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549dc8de-80ad-43f0-bf36-bffb31982435 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:22.955623 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4588da7-acea-4a33-bdaa-dd383b3b11da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:22.956383 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4588da7-acea-4a33-bdaa-dd383b3b11da None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:22.956757 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4588da7-acea-4a33-bdaa-dd383b3b11da None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:22.957133 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4588da7-acea-4a33-bdaa-dd383b3b11da None admin] PATH_INFO: `/v3/services` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:22.957926 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4588da7-acea-4a33-bdaa-dd383b3b11da None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:26:22.958328 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4588da7-acea-4a33-bdaa-dd383b3b11da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:22.959894 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4588da7-acea-4a33-bdaa-dd383b3b11da None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:22.966331 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 378/758] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jul 26 15:26:22 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:26:23.594761 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fca978-a19f-40bf-a8fa-f1fc7aa4a3df None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:23.595325 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fca978-a19f-40bf-a8fa-f1fc7aa4a3df None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:23.595595 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fca978-a19f-40bf-a8fa-f1fc7aa4a3df None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:23.596961 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 381/759] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:26:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:26:23.602473 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d658d76a-26bc-46c7-b06e-645a774c09b7 None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:23.602988 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d658d76a-26bc-46c7-b06e-645a774c09b7 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:23.603171 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d658d76a-26bc-46c7-b06e-645a774c09b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:23.622756 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-d658d76a-26bc-46c7-b06e-645a774c09b7 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:26:23.624031 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-d658d76a-26bc-46c7-b06e-645a774c09b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:26:23.658204 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:23.715207 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 379/760] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:26:23 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 15:26:23.740150 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fca978-a19f-40bf-a8fa-f1fc7aa4a3df None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:23.857913 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fca978-a19f-40bf-a8fa-f1fc7aa4a3df None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:23.896790 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b072fb5-b41d-41f2-84ec-ffa3e7e5ce5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:23.897416 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b072fb5-b41d-41f2-84ec-ffa3e7e5ce5a None admin] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:23.897695 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b072fb5-b41d-41f2-84ec-ffa3e7e5ce5a None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:23.897972 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b072fb5-b41d-41f2-84ec-ffa3e7e5ce5a None admin] PATH_INFO: `/v3/services` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:23.898681 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b072fb5-b41d-41f2-84ec-ffa3e7e5ce5a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:23.900797 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b072fb5-b41d-41f2-84ec-ffa3e7e5ce5a None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:23.995719 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 382/761] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Jul 26 15:26:23 2022] POST /identity/v3/services => generated 269 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:26:25.558888 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb6cb8-8b37-4edb-9df9-9293438dc1fa None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:25.559806 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb6cb8-8b37-4edb-9df9-9293438dc1fa None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:25.559806 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb6cb8-8b37-4edb-9df9-9293438dc1fa None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:25.560840 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 380/762] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:26:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 15:26:25.568915 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2e168-7e20-4d4b-9dbe-e1df9dc5291c None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:25.569697 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2e168-7e20-4d4b-9dbe-e1df9dc5291c None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:25.569892 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2e168-7e20-4d4b-9dbe-e1df9dc5291c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:25.591691 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-4de2e168-7e20-4d4b-9dbe-e1df9dc5291c None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:26:25.592909 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-4de2e168-7e20-4d4b-9dbe-e1df9dc5291c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:26:25.609558 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:25.690998 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 383/763] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:26:25 2022] POST /identity/v3/auth/tokens => generated 1506 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 15:26:25.720129 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb6cb8-8b37-4edb-9df9-9293438dc1fa None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:25.845926 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb6cb8-8b37-4edb-9df9-9293438dc1fa None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:25.884601 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f55913-6dcd-433a-9de8-715ce13e91de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:25.885396 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f55913-6dcd-433a-9de8-715ce13e91de None admin] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:25.885731 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f55913-6dcd-433a-9de8-715ce13e91de None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:25.892719 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f55913-6dcd-433a-9de8-715ce13e91de None admin] PATH_INFO: `/v3/services` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:25.892719 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f55913-6dcd-433a-9de8-715ce13e91de None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:25.892719 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f55913-6dcd-433a-9de8-715ce13e91de None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:26.007935 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 381/764] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Jul 26 15:26:25 2022] POST /identity/v3/services => generated 251 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:26:26.408854 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97edf302-ff77-4193-82ac-f5c3d36a9e0d None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:26.409164 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97edf302-ff77-4193-82ac-f5c3d36a9e0d None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:26.409404 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97edf302-ff77-4193-82ac-f5c3d36a9e0d None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:26.410974 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 384/765] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:26:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 15:26:26.417268 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040b197-e382-4ba9-b6a8-65a1b72e9cdf None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:26.417530 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040b197-e382-4ba9-b6a8-65a1b72e9cdf None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:26.418060 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040b197-e382-4ba9-b6a8-65a1b72e9cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:26.437859 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-a040b197-e382-4ba9-b6a8-65a1b72e9cdf None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:26:26.439069 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-a040b197-e382-4ba9-b6a8-65a1b72e9cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:26:26.462155 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:26.524691 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 382/766] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:26:26 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 15:26:26.550474 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97edf302-ff77-4193-82ac-f5c3d36a9e0d None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:26.663020 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97edf302-ff77-4193-82ac-f5c3d36a9e0d None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:26.704169 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb3a1d9-ba84-4802-9ccc-f0ecc4d9d86f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:26.704865 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3a1d9-ba84-4802-9ccc-f0ecc4d9d86f None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:26.705148 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3a1d9-ba84-4802-9ccc-f0ecc4d9d86f None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:26.705425 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3a1d9-ba84-4802-9ccc-f0ecc4d9d86f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:26.706067 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb3a1d9-ba84-4802-9ccc-f0ecc4d9d86f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:26.707524 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb3a1d9-ba84-4802-9ccc-f0ecc4d9d86f None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:26.717360 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application [None req-4bb3a1d9-ba84-4802-9ccc-f0ecc4d9d86f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 15:26:26.717360 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:26:26.717360 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 15:26:26.717360 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 15:26:26.717360 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 15:26:26.717360 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 15:26:26.717360 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 15:26:26.717360 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 15:26:26.717360 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 15:26:26.717360 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:26:26.717360 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 15:26:26.717360 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:26:26.717360 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:26:26.717360 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:26:26.717360 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:26:26.717360 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:26:26.719601 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:26:26.719601 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:26:26.719601 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:26:26.719601 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:26:26.719601 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:26:26.719601 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:26:26.719601 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:26:26.719601 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 15:26:26.719601 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 15:26:26.719601 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 15:26:26.719601 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 15:26:26.719601 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:26:26.719601 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:26:26.719601 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:26:26.719601 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:26:26.719601 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:26:26.726902 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:26:26.726902 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:26:26.726902 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application with Lock( Jul 26 15:26:26.726902 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:26:26.726902 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:26:26.726902 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:26:26.726902 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:26:26.726902 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:26:26.726902 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:26:26.726902 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:26:26.726902 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:26:26.726902 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 15:26:26.726902 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 15:26:26.726902 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 15:26:26.726902 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:26:26.726902 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 385/767] 10.222.0.18 () {56 vars in 1132 bytes} [Tue Jul 26 15:26:26 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 15:26:26.729379 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a040b197-e382-4ba9-b6a8-65a1b72e9cdf None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:26.844767 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a040b197-e382-4ba9-b6a8-65a1b72e9cdf None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:26.882597 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142f2610-0f76-47bc-99db-9b1cb8dc51ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:26.883262 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f2610-0f76-47bc-99db-9b1cb8dc51ce None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:26.883554 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f2610-0f76-47bc-99db-9b1cb8dc51ce None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:26.883833 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f2610-0f76-47bc-99db-9b1cb8dc51ce None admin] PATH_INFO: `/v3/services` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:26.885022 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142f2610-0f76-47bc-99db-9b1cb8dc51ce None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:26:26.885331 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142f2610-0f76-47bc-99db-9b1cb8dc51ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:26.886857 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142f2610-0f76-47bc-99db-9b1cb8dc51ce None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:26.892647 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 383/768] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Jul 26 15:26:26 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:26:26.898961 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb3a1d9-ba84-4802-9ccc-f0ecc4d9d86f None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:26.912662 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:27.032380 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb3a1d9-ba84-4802-9ccc-f0ecc4d9d86f None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:27.076504 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d02da5-f57b-4f8f-9d34-7d2efb4ac64d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:27.077136 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d02da5-f57b-4f8f-9d34-7d2efb4ac64d None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:27.077414 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d02da5-f57b-4f8f-9d34-7d2efb4ac64d None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:27.077692 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d02da5-f57b-4f8f-9d34-7d2efb4ac64d None admin] PATH_INFO: `/v3/services` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:27.078376 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d02da5-f57b-4f8f-9d34-7d2efb4ac64d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:26:27.078688 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d02da5-f57b-4f8f-9d34-7d2efb4ac64d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:27.080108 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d02da5-f57b-4f8f-9d34-7d2efb4ac64d None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:27.085533 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 386/769] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Jul 26 15:26:26 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:26:27.092555 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142f2610-0f76-47bc-99db-9b1cb8dc51ce None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:27.113001 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:27.207524 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142f2610-0f76-47bc-99db-9b1cb8dc51ce None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:27.245807 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3f56bb-784a-4f8f-b915-49d00900b11c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:27.246446 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3f56bb-784a-4f8f-b915-49d00900b11c None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:27.246779 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3f56bb-784a-4f8f-b915-49d00900b11c None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:27.247034 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3f56bb-784a-4f8f-b915-49d00900b11c None admin] PATH_INFO: `/v3/endpoints` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:27.289819 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3f56bb-784a-4f8f-b915-49d00900b11c None admin] RBAC: Adding query filter params (interface=public, service_id=22a8b8d83351426e88d132a74253d288, region_id=RegionOne) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:26:27.289819 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3f56bb-784a-4f8f-b915-49d00900b11c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:27.289819 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3f56bb-784a-4f8f-b915-49d00900b11c None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:27.289819 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 384/770] 10.222.0.18 () {56 vars in 1251 bytes} [Tue Jul 26 15:26:27 2022] GET /identity/v3/endpoints?service_id=22a8b8d83351426e88d132a74253d288&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:26:27.290435 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d02da5-f57b-4f8f-9d34-7d2efb4ac64d None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:27.347266 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:27.381221 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d02da5-f57b-4f8f-9d34-7d2efb4ac64d None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:27.420594 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c67191-47c2-4dbc-b056-268bc3437263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:27.421219 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c67191-47c2-4dbc-b056-268bc3437263 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:27.421504 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c67191-47c2-4dbc-b056-268bc3437263 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:27.421784 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c67191-47c2-4dbc-b056-268bc3437263 None admin] PATH_INFO: `/v3/services` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:27.422453 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c67191-47c2-4dbc-b056-268bc3437263 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:27.423889 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c67191-47c2-4dbc-b056-268bc3437263 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:27.430821 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 387/771] 10.222.0.18 () {56 vars in 1087 bytes} [Tue Jul 26 15:26:27 2022] GET /identity/v3/services => generated 1498 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:26:28.394020 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89604b7-7479-4dc6-9aaa-c68a6b0dd52f None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:28.394597 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89604b7-7479-4dc6-9aaa-c68a6b0dd52f None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:28.394984 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89604b7-7479-4dc6-9aaa-c68a6b0dd52f None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:28.397487 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 385/772] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:26:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:26:28.406083 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12983e8-07f8-4a3c-a237-86d9e36ba4f6 None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:28.406646 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12983e8-07f8-4a3c-a237-86d9e36ba4f6 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:28.407170 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12983e8-07f8-4a3c-a237-86d9e36ba4f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:28.439741 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-f12983e8-07f8-4a3c-a237-86d9e36ba4f6 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:26:28.441798 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-f12983e8-07f8-4a3c-a237-86d9e36ba4f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:26:28.551116 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 388/773] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:26:28 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 15:26:28.593926 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89604b7-7479-4dc6-9aaa-c68a6b0dd52f None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:28.689821 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:28.713021 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89604b7-7479-4dc6-9aaa-c68a6b0dd52f None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:28.752076 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472bd774-a4d2-48b7-99d2-37879f4e41a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:28.752802 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472bd774-a4d2-48b7-99d2-37879f4e41a8 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:28.753145 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472bd774-a4d2-48b7-99d2-37879f4e41a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:28.753504 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472bd774-a4d2-48b7-99d2-37879f4e41a8 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:28.754208 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472bd774-a4d2-48b7-99d2-37879f4e41a8 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:28.755742 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472bd774-a4d2-48b7-99d2-37879f4e41a8 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:28.765475 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-472bd774-a4d2-48b7-99d2-37879f4e41a8 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 15:26:28.765475 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:26:28.765475 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 15:26:28.765475 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 15:26:28.765475 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 15:26:28.765475 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 15:26:28.765475 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 15:26:28.765475 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 15:26:28.765475 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 15:26:28.765475 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:26:28.765475 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 15:26:28.765475 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:26:28.765475 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:26:28.765475 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:26:28.765475 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:26:28.765475 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:26:28.765475 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:26:28.767482 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:26:28.767482 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:26:28.767482 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:26:28.767482 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:26:28.767482 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:26:28.767482 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:26:28.767482 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 15:26:28.767482 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 15:26:28.767482 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 15:26:28.767482 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 15:26:28.767482 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:26:28.767482 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:26:28.767482 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:26:28.767482 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:26:28.767482 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:26:28.767482 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:26:28.769117 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:26:28.769117 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:26:28.769117 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:26:28.769117 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:26:28.769117 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:26:28.769117 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:26:28.769117 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:26:28.769117 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:26:28.769117 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:26:28.769117 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:26:28.769117 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 15:26:28.769117 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 15:26:28.769117 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 15:26:28.769117 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:26:28.769117 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 386/774] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jul 26 15:26:28 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:26:28.773739 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12983e8-07f8-4a3c-a237-86d9e36ba4f6 None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:28.880568 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:28.923212 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12983e8-07f8-4a3c-a237-86d9e36ba4f6 None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:28.960341 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173cd8c6-86e8-4015-9ce4-5a285b9f7a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:28.960969 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173cd8c6-86e8-4015-9ce4-5a285b9f7a55 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:28.961250 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173cd8c6-86e8-4015-9ce4-5a285b9f7a55 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:28.961523 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173cd8c6-86e8-4015-9ce4-5a285b9f7a55 None admin] PATH_INFO: `/v3/services` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:28.962208 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173cd8c6-86e8-4015-9ce4-5a285b9f7a55 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:26:28.962587 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173cd8c6-86e8-4015-9ce4-5a285b9f7a55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:28.964025 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173cd8c6-86e8-4015-9ce4-5a285b9f7a55 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:28.969180 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 389/775] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jul 26 15:26:28 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:26:28.974920 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472bd774-a4d2-48b7-99d2-37879f4e41a8 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:29.086241 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472bd774-a4d2-48b7-99d2-37879f4e41a8 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:29.122160 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2e6e7e-7747-4181-94a7-aee0c46e2909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:29.122788 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e6e7e-7747-4181-94a7-aee0c46e2909 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:29.123078 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e6e7e-7747-4181-94a7-aee0c46e2909 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:29.123389 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e6e7e-7747-4181-94a7-aee0c46e2909 None admin] PATH_INFO: `/v3/services` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:29.124080 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2e6e7e-7747-4181-94a7-aee0c46e2909 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:26:29.124390 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2e6e7e-7747-4181-94a7-aee0c46e2909 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:29.125798 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2e6e7e-7747-4181-94a7-aee0c46e2909 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:29.130991 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 387/776] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jul 26 15:26:28 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:26:29.136971 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173cd8c6-86e8-4015-9ce4-5a285b9f7a55 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:29.248212 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173cd8c6-86e8-4015-9ce4-5a285b9f7a55 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:29.281618 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:29.287445 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0063df-cdef-402d-ab01-00c71423cef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:29.288084 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0063df-cdef-402d-ab01-00c71423cef2 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:29.288369 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0063df-cdef-402d-ab01-00c71423cef2 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:29.288646 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0063df-cdef-402d-ab01-00c71423cef2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:29.289411 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0063df-cdef-402d-ab01-00c71423cef2 None admin] RBAC: Adding query filter params (interface=public, service_id=f0b168da0f834e5e9bee17c7def1ec0e, region_id=RegionOne) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:26:29.289725 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0063df-cdef-402d-ab01-00c71423cef2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:29.291117 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0063df-cdef-402d-ab01-00c71423cef2 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:29.296917 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 390/777] 10.222.0.18 () {56 vars in 1251 bytes} [Tue Jul 26 15:26:29 2022] GET /identity/v3/endpoints?service_id=f0b168da0f834e5e9bee17c7def1ec0e&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:26:29.304155 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2e6e7e-7747-4181-94a7-aee0c46e2909 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:29.316900 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:29.410870 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2e6e7e-7747-4181-94a7-aee0c46e2909 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:29.445049 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e7045-bf52-4fe6-b1c1-28612520a9a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:29.445668 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e7045-bf52-4fe6-b1c1-28612520a9a6 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:29.445949 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e7045-bf52-4fe6-b1c1-28612520a9a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:29.446224 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e7045-bf52-4fe6-b1c1-28612520a9a6 None admin] PATH_INFO: `/v3/services` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:29.447668 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2e7045-bf52-4fe6-b1c1-28612520a9a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:29.448910 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2e7045-bf52-4fe6-b1c1-28612520a9a6 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:29.467178 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 388/778] 10.222.0.18 () {56 vars in 1087 bytes} [Tue Jul 26 15:26:29 2022] GET /identity/v3/services => generated 1498 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:26:29.760599 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51bfdba-5f36-4144-8110-594d4ef68c90 None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:29.761207 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51bfdba-5f36-4144-8110-594d4ef68c90 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:29.761207 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51bfdba-5f36-4144-8110-594d4ef68c90 None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:29.762498 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 391/779] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:26:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:26:29.767877 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de285c2f-c884-4834-8f64-c607e0bbc9e7 None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:29.768303 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de285c2f-c884-4834-8f64-c607e0bbc9e7 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:29.768713 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de285c2f-c884-4834-8f64-c607e0bbc9e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:29.788229 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-de285c2f-c884-4834-8f64-c607e0bbc9e7 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:26:29.789472 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-de285c2f-c884-4834-8f64-c607e0bbc9e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:26:29.860606 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 389/780] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:26:29 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 15:26:29.885294 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51bfdba-5f36-4144-8110-594d4ef68c90 None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:29.995189 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51bfdba-5f36-4144-8110-594d4ef68c90 None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:30.031026 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcf138a-bd49-4eaa-b698-1bd1897ce489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:30.031594 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcf138a-bd49-4eaa-b698-1bd1897ce489 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:30.031879 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcf138a-bd49-4eaa-b698-1bd1897ce489 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:30.032156 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcf138a-bd49-4eaa-b698-1bd1897ce489 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:30.032790 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcf138a-bd49-4eaa-b698-1bd1897ce489 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:30.034168 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcf138a-bd49-4eaa-b698-1bd1897ce489 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:30.044275 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application [None req-3fcf138a-bd49-4eaa-b698-1bd1897ce489 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 15:26:30.044275 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:26:30.044275 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 15:26:30.044275 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 15:26:30.044275 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 15:26:30.044275 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 15:26:30.044275 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 15:26:30.044275 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 15:26:30.044275 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 15:26:30.044275 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:26:30.044275 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 15:26:30.044275 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:26:30.044275 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:26:30.044275 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:26:30.044275 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:26:30.044275 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:26:30.046161 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:26:30.046161 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:26:30.046161 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:26:30.046161 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:26:30.046161 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:26:30.046161 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:26:30.046161 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:26:30.046161 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 15:26:30.046161 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 15:26:30.046161 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 15:26:30.046161 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 15:26:30.046161 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:26:30.046161 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:26:30.046161 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:26:30.046161 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:26:30.046161 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:26:30.047690 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:26:30.047690 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:26:30.047690 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application with Lock( Jul 26 15:26:30.047690 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:26:30.047690 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:26:30.047690 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:26:30.047690 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:26:30.047690 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:26:30.047690 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:26:30.047690 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:26:30.047690 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:26:30.047690 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 15:26:30.047690 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 15:26:30.047690 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 15:26:30.047690 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:26:30.050559 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 392/781] 10.222.0.18 () {56 vars in 1132 bytes} [Tue Jul 26 15:26:29 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:26:30.051767 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de285c2f-c884-4834-8f64-c607e0bbc9e7 None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:30.054194 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:30.157033 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de285c2f-c884-4834-8f64-c607e0bbc9e7 None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:30.193082 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4befad80-6520-4e4c-a1c6-a77e1cfd1209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:30.193936 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4befad80-6520-4e4c-a1c6-a77e1cfd1209 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:30.194406 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4befad80-6520-4e4c-a1c6-a77e1cfd1209 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:30.194825 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4befad80-6520-4e4c-a1c6-a77e1cfd1209 None admin] PATH_INFO: `/v3/services` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:30.195755 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4befad80-6520-4e4c-a1c6-a77e1cfd1209 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:26:30.196153 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4befad80-6520-4e4c-a1c6-a77e1cfd1209 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:30.197680 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4befad80-6520-4e4c-a1c6-a77e1cfd1209 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:30.203409 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 390/782] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Jul 26 15:26:30 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:26:30.209651 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcf138a-bd49-4eaa-b698-1bd1897ce489 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:30.275573 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:30.319779 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcf138a-bd49-4eaa-b698-1bd1897ce489 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:30.356299 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc27063b-1a29-4115-bdde-38056880bdf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:30.356927 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27063b-1a29-4115-bdde-38056880bdf5 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:30.357208 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27063b-1a29-4115-bdde-38056880bdf5 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:30.357485 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27063b-1a29-4115-bdde-38056880bdf5 None admin] PATH_INFO: `/v3/services` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:30.358175 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc27063b-1a29-4115-bdde-38056880bdf5 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:26:30.358483 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc27063b-1a29-4115-bdde-38056880bdf5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:30.359909 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc27063b-1a29-4115-bdde-38056880bdf5 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:30.365389 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 393/783] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Jul 26 15:26:30 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:26:30.374866 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4befad80-6520-4e4c-a1c6-a77e1cfd1209 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:30.448294 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:30.484831 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4befad80-6520-4e4c-a1c6-a77e1cfd1209 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:30.521079 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a7d9e1-bb87-453d-ab5c-484ee0be65b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:30.521712 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a7d9e1-bb87-453d-ab5c-484ee0be65b7 None admin] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:30.521996 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a7d9e1-bb87-453d-ab5c-484ee0be65b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:30.522271 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a7d9e1-bb87-453d-ab5c-484ee0be65b7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:30.522998 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a7d9e1-bb87-453d-ab5c-484ee0be65b7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:30.524446 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a7d9e1-bb87-453d-ab5c-484ee0be65b7 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:30.604504 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 391/784] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Jul 26 15:26:30 2022] POST /identity/v3/endpoints => generated 347 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:26:31.765890 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573954e2-4b60-4d82-b133-45cdebb9136a None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:31.766517 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573954e2-4b60-4d82-b133-45cdebb9136a None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:31.767007 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573954e2-4b60-4d82-b133-45cdebb9136a None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:31.769679 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 394/785] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:26:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:26:31.779167 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9313ae5a-4670-4996-a886-b4ed13ad88b0 None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:31.779958 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9313ae5a-4670-4996-a886-b4ed13ad88b0 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:31.779958 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9313ae5a-4670-4996-a886-b4ed13ad88b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:31.811455 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-9313ae5a-4670-4996-a886-b4ed13ad88b0 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:26:31.813427 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-9313ae5a-4670-4996-a886-b4ed13ad88b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:26:31.936676 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 392/786] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:26:31 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 15:26:31.961187 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573954e2-4b60-4d82-b133-45cdebb9136a None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:32.085082 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573954e2-4b60-4d82-b133-45cdebb9136a None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:32.112351 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:32.126260 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a867af2-fcb6-4a59-832a-67f70368890f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:32.127054 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a867af2-fcb6-4a59-832a-67f70368890f None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:32.127438 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a867af2-fcb6-4a59-832a-67f70368890f None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:32.127823 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a867af2-fcb6-4a59-832a-67f70368890f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:32.128605 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a867af2-fcb6-4a59-832a-67f70368890f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:32.130172 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a867af2-fcb6-4a59-832a-67f70368890f None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:32.140299 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application [None req-5a867af2-fcb6-4a59-832a-67f70368890f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 15:26:32.140299 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:26:32.140299 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 15:26:32.140299 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 15:26:32.140299 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 15:26:32.140299 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 15:26:32.140299 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 15:26:32.140299 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 15:26:32.140299 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 15:26:32.140299 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:26:32.140299 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 15:26:32.140299 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:26:32.140299 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:26:32.140299 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:26:32.140299 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:26:32.140299 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:26:32.140299 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:26:32.141624 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:26:32.141624 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:26:32.141624 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:26:32.141624 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:26:32.141624 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:26:32.141624 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:26:32.141624 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 15:26:32.141624 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 15:26:32.141624 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 15:26:32.141624 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 15:26:32.141624 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:26:32.141624 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:26:32.141624 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:26:32.141624 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:26:32.141624 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:26:32.141624 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:26:32.142702 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:26:32.142702 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application with Lock( Jul 26 15:26:32.142702 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:26:32.142702 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:26:32.142702 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:26:32.142702 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:26:32.142702 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:26:32.142702 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:26:32.142702 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:26:32.142702 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:26:32.142702 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 15:26:32.142702 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 15:26:32.142702 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 15:26:32.142702 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:26:32.142702 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 395/787] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jul 26 15:26:31 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 15:26:32.150724 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9313ae5a-4670-4996-a886-b4ed13ad88b0 None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:32.206724 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:32.300652 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9313ae5a-4670-4996-a886-b4ed13ad88b0 None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:32.356568 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a267f1a-2961-49a0-b8ac-3b937d48bbcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:32.357227 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a267f1a-2961-49a0-b8ac-3b937d48bbcf None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:32.357575 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a267f1a-2961-49a0-b8ac-3b937d48bbcf None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:32.357919 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a267f1a-2961-49a0-b8ac-3b937d48bbcf None admin] PATH_INFO: `/v3/services` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:32.358732 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a267f1a-2961-49a0-b8ac-3b937d48bbcf None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:26:32.359108 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a267f1a-2961-49a0-b8ac-3b937d48bbcf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:32.360685 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a267f1a-2961-49a0-b8ac-3b937d48bbcf None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:32.366548 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 393/788] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jul 26 15:26:32 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:26:32.376070 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a867af2-fcb6-4a59-832a-67f70368890f None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:32.512545 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a867af2-fcb6-4a59-832a-67f70368890f None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:32.553718 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c205a16c-4dbe-4619-8ba5-c97d43346da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:32.554462 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c205a16c-4dbe-4619-8ba5-c97d43346da0 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:32.554850 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c205a16c-4dbe-4619-8ba5-c97d43346da0 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:32.555259 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c205a16c-4dbe-4619-8ba5-c97d43346da0 None admin] PATH_INFO: `/v3/services` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:32.556076 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c205a16c-4dbe-4619-8ba5-c97d43346da0 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:26:32.556475 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c205a16c-4dbe-4619-8ba5-c97d43346da0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:32.557987 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c205a16c-4dbe-4619-8ba5-c97d43346da0 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:32.563790 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 396/789] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jul 26 15:26:32 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:26:32.570219 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a267f1a-2961-49a0-b8ac-3b937d48bbcf None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:32.698632 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a267f1a-2961-49a0-b8ac-3b937d48bbcf None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:32.723222 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:32.760202 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c1c50a-e8b3-4878-a0eb-d04d567f4d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:32.761264 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c1c50a-e8b3-4878-a0eb-d04d567f4d08 None admin] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:32.761844 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c1c50a-e8b3-4878-a0eb-d04d567f4d08 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:32.762125 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c1c50a-e8b3-4878-a0eb-d04d567f4d08 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:32.762853 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c1c50a-e8b3-4878-a0eb-d04d567f4d08 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:32.764321 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c1c50a-e8b3-4878-a0eb-d04d567f4d08 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:32.875155 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 394/790] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Jul 26 15:26:32 2022] POST /identity/v3/endpoints => generated 346 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:26:32.999649 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2112c41b-53d3-4bf1-be85-e203840ac223 None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:33.000390 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2112c41b-53d3-4bf1-be85-e203840ac223 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:33.000390 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2112c41b-53d3-4bf1-be85-e203840ac223 None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:33.001817 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 397/791] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:26:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 15:26:33.008997 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a1f8b-63f0-4f1d-9a79-244dffcc523a None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:33.010207 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a1f8b-63f0-4f1d-9a79-244dffcc523a None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:33.010706 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a1f8b-63f0-4f1d-9a79-244dffcc523a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:33.045089 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-531a1f8b-63f0-4f1d-9a79-244dffcc523a None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:26:33.046724 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-531a1f8b-63f0-4f1d-9a79-244dffcc523a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:26:33.140561 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 395/792] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:26:33 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 15:26:33.163640 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2112c41b-53d3-4bf1-be85-e203840ac223 None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:33.219542 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:33.289277 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2112c41b-53d3-4bf1-be85-e203840ac223 None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:33.329595 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484eeaea-4dc1-412b-bdb1-345d88e5753b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:33.330255 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484eeaea-4dc1-412b-bdb1-345d88e5753b None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:33.330537 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484eeaea-4dc1-412b-bdb1-345d88e5753b None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:33.330817 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484eeaea-4dc1-412b-bdb1-345d88e5753b None admin] PATH_INFO: `/v3/services/compute` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:33.331495 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484eeaea-4dc1-412b-bdb1-345d88e5753b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:33.332888 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484eeaea-4dc1-412b-bdb1-345d88e5753b None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:33.342714 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application [None req-484eeaea-4dc1-412b-bdb1-345d88e5753b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 15:26:33.342714 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:26:33.342714 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 15:26:33.342714 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 15:26:33.342714 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 15:26:33.342714 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 15:26:33.342714 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 15:26:33.342714 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 15:26:33.342714 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 15:26:33.342714 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:26:33.342714 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 15:26:33.342714 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:26:33.342714 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:26:33.342714 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:26:33.342714 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:26:33.342714 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:26:33.342714 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:26:33.344077 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:26:33.344077 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:26:33.344077 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:26:33.344077 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:26:33.344077 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:26:33.344077 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:26:33.344077 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 15:26:33.344077 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 15:26:33.344077 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 15:26:33.344077 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 15:26:33.344077 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:26:33.344077 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:26:33.344077 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:26:33.344077 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:26:33.344077 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:26:33.344077 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:26:33.345022 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:26:33.345022 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application with Lock( Jul 26 15:26:33.345022 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:26:33.345022 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:26:33.345022 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:26:33.345022 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:26:33.345022 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:26:33.345022 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:26:33.345022 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:26:33.345022 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:26:33.345022 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 15:26:33.345022 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 15:26:33.345022 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 15:26:33.345022 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:26:33.345022 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 398/793] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 15:26:33 2022] GET /identity/v3/services/compute => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:26:33.351292 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531a1f8b-63f0-4f1d-9a79-244dffcc523a None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:33.508848 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:33.516217 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531a1f8b-63f0-4f1d-9a79-244dffcc523a None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:33.561693 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dffada1-d723-47fc-a4b0-3bed243d2dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:33.562491 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dffada1-d723-47fc-a4b0-3bed243d2dec None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:33.563005 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dffada1-d723-47fc-a4b0-3bed243d2dec None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:33.563815 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dffada1-d723-47fc-a4b0-3bed243d2dec None admin] PATH_INFO: `/v3/services` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:33.569468 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dffada1-d723-47fc-a4b0-3bed243d2dec None admin] RBAC: Adding query filter params (name=compute) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:26:33.569468 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dffada1-d723-47fc-a4b0-3bed243d2dec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:33.569468 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dffada1-d723-47fc-a4b0-3bed243d2dec None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:33.577499 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 396/794] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Jul 26 15:26:33 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:26:33.583586 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484eeaea-4dc1-412b-bdb1-345d88e5753b None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:33.711518 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484eeaea-4dc1-412b-bdb1-345d88e5753b None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:33.728585 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:33.755368 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21669ab-1ab4-4fc0-8ce3-109bc4f1d7fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:33.756055 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21669ab-1ab4-4fc0-8ce3-109bc4f1d7fe None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:33.756347 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21669ab-1ab4-4fc0-8ce3-109bc4f1d7fe None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:33.756628 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21669ab-1ab4-4fc0-8ce3-109bc4f1d7fe None admin] PATH_INFO: `/v3/services` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:33.757416 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21669ab-1ab4-4fc0-8ce3-109bc4f1d7fe None admin] RBAC: Adding query filter params (type=compute) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:26:33.757731 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21669ab-1ab4-4fc0-8ce3-109bc4f1d7fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:33.759839 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21669ab-1ab4-4fc0-8ce3-109bc4f1d7fe None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:33.766156 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 399/795] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Jul 26 15:26:33 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:26:35.254439 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad04e6bc-9186-4b4a-aa05-1ba3b545a55e None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:35.255051 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad04e6bc-9186-4b4a-aa05-1ba3b545a55e None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:35.255051 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad04e6bc-9186-4b4a-aa05-1ba3b545a55e None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:35.256468 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 397/796] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:26:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:26:35.262482 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ab533-513c-4ea6-a38d-64315ec504c1 None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:35.262966 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ab533-513c-4ea6-a38d-64315ec504c1 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:35.263083 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ab533-513c-4ea6-a38d-64315ec504c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:35.281890 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-6f4ab533-513c-4ea6-a38d-64315ec504c1 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:26:35.283114 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-6f4ab533-513c-4ea6-a38d-64315ec504c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:26:35.353362 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 400/797] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:26:35 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 15:26:35.378245 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad04e6bc-9186-4b4a-aa05-1ba3b545a55e None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:35.496178 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad04e6bc-9186-4b4a-aa05-1ba3b545a55e None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:35.534996 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874e4aef-63c9-46b3-b930-8bae4cc894cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:35.535550 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e4aef-63c9-46b3-b930-8bae4cc894cf None admin] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:35.535835 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e4aef-63c9-46b3-b930-8bae4cc894cf None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:35.536115 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e4aef-63c9-46b3-b930-8bae4cc894cf None admin] PATH_INFO: `/v3/projects` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:35.536805 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874e4aef-63c9-46b3-b930-8bae4cc894cf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:35.538293 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874e4aef-63c9-46b3-b930-8bae4cc894cf None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:35.541577 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: WARNING keystone.server.flask.common [None req-874e4aef-63c9-46b3-b930-8bae4cc894cf None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 26 15:26:35.593366 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.sql.core [None req-874e4aef-63c9-46b3-b930-8bae4cc894cf None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 26 15:26:35.593366 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 26 15:26:35.593366 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [parameters: {'id': '4883fac5003248438322176652c12455', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 26 15:26:35.593366 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87363) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 26 15:26:35.611386 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-874e4aef-63c9-46b3-b930-8bae4cc894cf None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4883fac5003248438322176652c12455.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4883fac5003248438322176652c12455. Jul 26 15:26:35.611386 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:26:35.611386 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 26 15:26:35.611386 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 26 15:26:35.611386 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 26 15:26:35.611386 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 26 15:26:35.611386 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 26 15:26:35.611386 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application result = self._query(query) Jul 26 15:26:35.611386 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 26 15:26:35.611386 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application conn.query(q) Jul 26 15:26:35.611386 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 26 15:26:35.611386 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 26 15:26:35.611386 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 26 15:26:35.613212 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application result.read() Jul 26 15:26:35.613212 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 26 15:26:35.613212 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 26 15:26:35.613212 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 26 15:26:35.613212 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 26 15:26:35.613212 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 26 15:26:35.613212 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 26 15:26:35.613212 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 26 15:26:35.613212 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 26 15:26:35.613212 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 26 15:26:35.613212 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:26:35.613212 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 26 15:26:35.613212 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:26:35.613212 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:26:35.613212 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 26 15:26:35.613212 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 26 15:26:35.613212 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 26 15:26:35.613212 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 26 15:26:35.615559 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 26 15:26:35.615559 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application next(self.gen) Jul 26 15:26:35.615559 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 26 15:26:35.615559 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application yield resource Jul 26 15:26:35.615559 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 26 15:26:35.615559 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application next(self.gen) Jul 26 15:26:35.615559 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 26 15:26:35.615559 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application self.session.rollback() Jul 26 15:26:35.615559 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 15:26:35.615559 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application self.force_reraise() Jul 26 15:26:35.615559 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 15:26:35.615559 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise self.value Jul 26 15:26:35.615559 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 26 15:26:35.615559 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 26 15:26:35.615559 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 26 15:26:35.615559 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application session.commit() Jul 26 15:26:35.615559 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 26 15:26:35.617835 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 26 15:26:35.617835 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 26 15:26:35.617835 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application self._prepare_impl() Jul 26 15:26:35.617835 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 26 15:26:35.617835 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application self.session.flush() Jul 26 15:26:35.617835 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 26 15:26:35.617835 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application self._flush(objects) Jul 26 15:26:35.617835 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 26 15:26:35.617835 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 26 15:26:35.617835 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 26 15:26:35.617835 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application compat.raise_( Jul 26 15:26:35.617835 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 26 15:26:35.617835 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception Jul 26 15:26:35.617835 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 26 15:26:35.617835 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application flush_context.execute() Jul 26 15:26:35.617835 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 26 15:26:35.617835 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rec.execute(self) Jul 26 15:26:35.619877 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 26 15:26:35.619877 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 26 15:26:35.619877 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 26 15:26:35.619877 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 26 15:26:35.619877 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 26 15:26:35.619877 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 26 15:26:35.619877 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 26 15:26:35.619877 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 26 15:26:35.619877 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 26 15:26:35.619877 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 26 15:26:35.619877 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 26 15:26:35.619877 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 26 15:26:35.619877 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 26 15:26:35.619877 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 26 15:26:35.619877 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 26 15:26:35.621751 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 26 15:26:35.621751 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 26 15:26:35.621751 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception Jul 26 15:26:35.621751 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 26 15:26:35.621751 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 26 15:26:35.621751 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 26 15:26:35.621751 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 26 15:26:35.621751 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 26 15:26:35.621751 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application result = self._query(query) Jul 26 15:26:35.621751 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 26 15:26:35.621751 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application conn.query(q) Jul 26 15:26:35.621751 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 26 15:26:35.621751 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 26 15:26:35.621751 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 26 15:26:35.621751 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application result.read() Jul 26 15:26:35.621751 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 26 15:26:35.621751 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 26 15:26:35.628599 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 26 15:26:35.628599 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 26 15:26:35.628599 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 26 15:26:35.628599 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 26 15:26:35.628599 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 26 15:26:35.628599 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 26 15:26:35.628599 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 26 15:26:35.628599 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 26 15:26:35.628599 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [parameters: {'id': '4883fac5003248438322176652c12455', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 26 15:26:35.628599 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 26 15:26:35.628599 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:26:35.628599 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 15:26:35.628599 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:26:35.628599 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:26:35.628599 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 26 15:26:35.629476 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 26 15:26:35.629476 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 26 15:26:35.629476 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 26 15:26:35.629476 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 26 15:26:35.629476 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:26:35.629476 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 15:26:35.629476 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:26:35.629476 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:26:35.629476 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:26:35.629476 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:26:35.629476 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:26:35.629476 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:26:35.629476 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:26:35.629476 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:26:35.629476 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:26:35.629476 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:26:35.629476 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:26:35.630443 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:26:35.630443 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 26 15:26:35.630443 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 26 15:26:35.630443 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:26:35.630443 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:26:35.630443 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 26 15:26:35.630443 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 26 15:26:35.630443 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4883fac5003248438322176652c12455. Jul 26 15:26:35.630443 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:26:35.630443 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 398/798] 10.222.0.18 () {60 vars in 1140 bytes} [Tue Jul 26 15:26:35 2022] POST /identity/v3/projects => generated 262 bytes in 240 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:26:35.631015 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4ab533-513c-4ea6-a38d-64315ec504c1 None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:35.804998 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4ab533-513c-4ea6-a38d-64315ec504c1 None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:35.824438 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:35.872763 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bba6e6-8541-4720-bc15-8f82963fded8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:35.873858 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bba6e6-8541-4720-bc15-8f82963fded8 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:35.874354 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bba6e6-8541-4720-bc15-8f82963fded8 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:35.874838 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bba6e6-8541-4720-bc15-8f82963fded8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:35.888286 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bba6e6-8541-4720-bc15-8f82963fded8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:35.890988 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bba6e6-8541-4720-bc15-8f82963fded8 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:35.913323 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application [None req-46bba6e6-8541-4720-bc15-8f82963fded8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:26:35.913323 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:26:35.913323 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:26:35.913323 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:26:35.913323 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:26:35.913323 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:26:35.913323 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:26:35.913323 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:26:35.913323 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:26:35.913323 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:26:35.913323 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:26:35.913323 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:26:35.913323 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 15:26:35.913323 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 15:26:35.913323 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 15:26:35.914444 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 15:26:35.914444 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:26:35.914444 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:26:35.914444 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:26:35.914444 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:26:35.914444 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:26:35.914444 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:26:35.914444 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:26:35.914444 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application with Lock( Jul 26 15:26:35.914444 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:26:35.914444 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:26:35.914444 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:26:35.914444 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:26:35.914444 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:26:35.914444 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:26:35.914444 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:26:35.914444 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:26:35.915513 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 15:26:35.915513 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 15:26:35.915513 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 15:26:35.915513 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 15:26:35.915513 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 15:26:35.915513 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 15:26:35.915513 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:26:35.915513 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:26:35.916306 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 401/799] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 15:26:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 15:26:35.922535 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874e4aef-63c9-46b3-b930-8bae4cc894cf None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:35.941583 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:36.039897 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874e4aef-63c9-46b3-b930-8bae4cc894cf None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:36.085830 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e62b5c-32bd-4e7f-b2d9-88f3e4223af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:36.086353 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e62b5c-32bd-4e7f-b2d9-88f3e4223af8 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:36.086633 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e62b5c-32bd-4e7f-b2d9-88f3e4223af8 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:36.086906 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e62b5c-32bd-4e7f-b2d9-88f3e4223af8 None admin] PATH_INFO: `/v3/projects` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:36.087725 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e62b5c-32bd-4e7f-b2d9-88f3e4223af8 None admin] RBAC: Adding query filter params (name=service) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:26:36.088094 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e62b5c-32bd-4e7f-b2d9-88f3e4223af8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:36.089801 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e62b5c-32bd-4e7f-b2d9-88f3e4223af8 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:36.112330 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 399/800] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Jul 26 15:26:35 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:26:36.494791 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1070d935-aafd-448f-9c9e-a43e2b923fc1 None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:36.495642 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1070d935-aafd-448f-9c9e-a43e2b923fc1 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:36.495642 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1070d935-aafd-448f-9c9e-a43e2b923fc1 None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:36.496983 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 402/801] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:26:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:26:36.503271 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96503f-9770-444b-9237-756e36173f28 None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:36.503993 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96503f-9770-444b-9237-756e36173f28 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:36.503993 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96503f-9770-444b-9237-756e36173f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:36.528681 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-ac96503f-9770-444b-9237-756e36173f28 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:26:36.530288 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-ac96503f-9770-444b-9237-756e36173f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:26:36.608421 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 400/802] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:26:36 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 15:26:36.632996 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1070d935-aafd-448f-9c9e-a43e2b923fc1 None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:36.758655 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1070d935-aafd-448f-9c9e-a43e2b923fc1 None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:36.795544 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b6a7f0-3578-494d-bf65-1ea0c41273bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:36.796175 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6a7f0-3578-494d-bf65-1ea0c41273bb None admin] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:36.796459 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6a7f0-3578-494d-bf65-1ea0c41273bb None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:36.796739 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6a7f0-3578-494d-bf65-1ea0c41273bb None admin] PATH_INFO: `/v3/services` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:36.797454 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b6a7f0-3578-494d-bf65-1ea0c41273bb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:36.798858 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b6a7f0-3578-494d-bf65-1ea0c41273bb None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:36.890536 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 403/803] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Jul 26 15:26:36 2022] POST /identity/v3/services => generated 242 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:26:38.489541 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de29e515-d9a3-4e33-94be-a2c934612c3b None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:38.490235 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de29e515-d9a3-4e33-94be-a2c934612c3b None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:38.490235 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de29e515-d9a3-4e33-94be-a2c934612c3b None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:38.494029 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 401/804] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:26:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:26:38.498858 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21445b0-f912-4577-8073-3122d2230a33 None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:38.499431 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21445b0-f912-4577-8073-3122d2230a33 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:38.499887 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21445b0-f912-4577-8073-3122d2230a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:38.531269 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-d21445b0-f912-4577-8073-3122d2230a33 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:26:38.533342 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-d21445b0-f912-4577-8073-3122d2230a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:26:38.564664 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:38.622554 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 404/805] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:26:38 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 15:26:38.648978 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de29e515-d9a3-4e33-94be-a2c934612c3b None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:38.656256 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:38.783771 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de29e515-d9a3-4e33-94be-a2c934612c3b None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:38.820226 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80b1df0-5046-47e5-884a-483070816e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:38.820850 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b1df0-5046-47e5-884a-483070816e42 None admin] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:38.821135 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b1df0-5046-47e5-884a-483070816e42 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:38.821446 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b1df0-5046-47e5-884a-483070816e42 None admin] PATH_INFO: `/v3/users` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:38.822139 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80b1df0-5046-47e5-884a-483070816e42 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:38.823681 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80b1df0-5046-47e5-884a-483070816e42 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:38.866543 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.sql.core [None req-c80b1df0-5046-47e5-884a-483070816e42 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 26 15:26:38.866543 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 26 15:26:38.866543 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [parameters: {'user_id': '3229412ee03444ff8aeab6342bf35846', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 26 15:26:38.866543 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87363) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 26 15:26:38.874868 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-c80b1df0-5046-47e5-884a-483070816e42 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 26 15:26:38.874868 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:26:38.874868 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 26 15:26:38.874868 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 26 15:26:38.874868 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 26 15:26:38.874868 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 26 15:26:38.874868 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 26 15:26:38.874868 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application result = self._query(query) Jul 26 15:26:38.874868 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 26 15:26:38.874868 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application conn.query(q) Jul 26 15:26:38.874868 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 26 15:26:38.874868 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 26 15:26:38.874868 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 26 15:26:38.874868 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application result.read() Jul 26 15:26:38.874868 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 26 15:26:38.881350 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 26 15:26:38.881350 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 26 15:26:38.881350 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 26 15:26:38.881350 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 26 15:26:38.881350 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 26 15:26:38.881350 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 26 15:26:38.881350 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 26 15:26:38.881350 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 26 15:26:38.881350 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:26:38.881350 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 26 15:26:38.881350 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:26:38.881350 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:26:38.881350 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 26 15:26:38.881350 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 26 15:26:38.881350 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 26 15:26:38.881350 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 26 15:26:38.881350 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 26 15:26:38.881350 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application next(self.gen) Jul 26 15:26:38.882532 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 26 15:26:38.882532 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application yield resource Jul 26 15:26:38.882532 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 26 15:26:38.882532 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application next(self.gen) Jul 26 15:26:38.882532 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 26 15:26:38.882532 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application self.session.rollback() Jul 26 15:26:38.882532 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 15:26:38.882532 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application self.force_reraise() Jul 26 15:26:38.882532 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 15:26:38.882532 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise self.value Jul 26 15:26:38.882532 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 26 15:26:38.882532 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 26 15:26:38.882532 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 26 15:26:38.882532 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application session.commit() Jul 26 15:26:38.882532 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 26 15:26:38.882532 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 26 15:26:38.882532 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 26 15:26:38.883642 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application self._prepare_impl() Jul 26 15:26:38.883642 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 26 15:26:38.883642 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application self.session.flush() Jul 26 15:26:38.883642 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 26 15:26:38.883642 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application self._flush(objects) Jul 26 15:26:38.883642 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 26 15:26:38.883642 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 26 15:26:38.883642 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 26 15:26:38.883642 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application compat.raise_( Jul 26 15:26:38.883642 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 26 15:26:38.883642 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception Jul 26 15:26:38.883642 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 26 15:26:38.883642 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application flush_context.execute() Jul 26 15:26:38.883642 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 26 15:26:38.883642 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rec.execute(self) Jul 26 15:26:38.883642 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 26 15:26:38.883642 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 26 15:26:38.885323 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 26 15:26:38.885323 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 26 15:26:38.885323 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 26 15:26:38.885323 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 26 15:26:38.885323 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 26 15:26:38.885323 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 26 15:26:38.885323 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 26 15:26:38.885323 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 26 15:26:38.885323 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 26 15:26:38.885323 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 26 15:26:38.885323 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 26 15:26:38.885323 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 26 15:26:38.885323 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 26 15:26:38.885323 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 26 15:26:38.885323 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 26 15:26:38.885323 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception Jul 26 15:26:38.886368 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 26 15:26:38.886368 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 26 15:26:38.886368 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 26 15:26:38.886368 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 26 15:26:38.886368 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 26 15:26:38.886368 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application result = self._query(query) Jul 26 15:26:38.886368 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 26 15:26:38.886368 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application conn.query(q) Jul 26 15:26:38.886368 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 26 15:26:38.886368 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 26 15:26:38.886368 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 26 15:26:38.886368 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application result.read() Jul 26 15:26:38.886368 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 26 15:26:38.886368 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 26 15:26:38.886368 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 26 15:26:38.886368 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 26 15:26:38.890539 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 26 15:26:38.890539 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 26 15:26:38.890539 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 26 15:26:38.890539 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 26 15:26:38.890539 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 26 15:26:38.890539 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 26 15:26:38.890539 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [parameters: {'user_id': '3229412ee03444ff8aeab6342bf35846', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 26 15:26:38.890539 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 26 15:26:38.890539 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:26:38.890539 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 15:26:38.890539 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:26:38.890539 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:26:38.890539 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:26:38.890539 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:26:38.890539 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:26:38.892470 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:26:38.892470 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:26:38.892470 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:26:38.892470 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:26:38.892470 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:26:38.892470 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:26:38.892470 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:26:38.892470 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 26 15:26:38.892470 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 26 15:26:38.892470 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:26:38.892470 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:26:38.892470 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 15:26:38.892470 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:26:38.892470 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 15:26:38.892470 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:26:38.892470 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 26 15:26:38.892470 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 26 15:26:38.893590 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 26 15:26:38.893590 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 26 15:26:38.893590 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 26 15:26:38.893590 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 26 15:26:38.893590 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 26 15:26:38.893590 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:26:38.893590 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 402/806] 10.222.0.18 () {60 vars in 1131 bytes} [Tue Jul 26 15:26:38 2022] POST /identity/v3/users => generated 160 bytes in 229 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:26:38.894062 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21445b0-f912-4577-8073-3122d2230a33 None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:39.000609 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21445b0-f912-4577-8073-3122d2230a33 None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:39.044495 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa8e223-0ac6-4cf1-9a6e-738f87cc0b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:39.045098 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa8e223-0ac6-4cf1-9a6e-738f87cc0b82 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:39.045383 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa8e223-0ac6-4cf1-9a6e-738f87cc0b82 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:39.045659 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa8e223-0ac6-4cf1-9a6e-738f87cc0b82 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:39.054720 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa8e223-0ac6-4cf1-9a6e-738f87cc0b82 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:39.057143 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa8e223-0ac6-4cf1-9a6e-738f87cc0b82 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:39.071326 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application [None req-0aa8e223-0ac6-4cf1-9a6e-738f87cc0b82 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 15:26:39.071326 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:26:39.071326 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:26:39.071326 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:26:39.071326 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:26:39.071326 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:26:39.071326 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:26:39.071326 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:26:39.071326 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:26:39.071326 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:26:39.071326 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:26:39.071326 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:26:39.071326 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 15:26:39.071326 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 15:26:39.071326 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 15:26:39.071326 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 15:26:39.073779 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:26:39.073779 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:26:39.073779 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 15:26:39.073779 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:26:39.073779 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 15:26:39.073779 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:26:39.073779 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:26:39.073779 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:26:39.073779 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:26:39.073779 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:26:39.073779 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:26:39.073779 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application with Lock( Jul 26 15:26:39.073779 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:26:39.073779 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:26:39.073779 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:26:39.073779 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:26:39.073779 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:26:39.073779 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:26:39.074812 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:26:39.074812 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:26:39.074812 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 15:26:39.074812 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 15:26:39.074812 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 15:26:39.074812 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 15:26:39.074812 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 15:26:39.074812 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 15:26:39.074812 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 15:26:39.074812 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:26:39.078555 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 405/807] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 15:26:38 2022] GET /identity/v3/users/cinder => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:26:39.080037 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80b1df0-5046-47e5-884a-483070816e42 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:39.165794 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:39.204036 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80b1df0-5046-47e5-884a-483070816e42 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:39.223779 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac251c-43d3-4389-902e-0e27180899f8 None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:39.224220 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac251c-43d3-4389-902e-0e27180899f8 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:39.224555 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac251c-43d3-4389-902e-0e27180899f8 None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:39.226314 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 406/808] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:26:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 15:26:39.232935 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c3594b-49f8-48d1-976b-187c794b1846 None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:39.233210 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c3594b-49f8-48d1-976b-187c794b1846 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:39.233484 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c3594b-49f8-48d1-976b-187c794b1846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:39.247796 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13043c17-a28e-4e49-a108-b2f713810a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:39.248468 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13043c17-a28e-4e49-a108-b2f713810a29 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:39.248953 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13043c17-a28e-4e49-a108-b2f713810a29 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:39.249240 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13043c17-a28e-4e49-a108-b2f713810a29 None admin] PATH_INFO: `/v3/users` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:39.250045 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13043c17-a28e-4e49-a108-b2f713810a29 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:26:39.250361 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13043c17-a28e-4e49-a108-b2f713810a29 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:39.252117 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13043c17-a28e-4e49-a108-b2f713810a29 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:39.253012 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-40c3594b-49f8-48d1-976b-187c794b1846 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:26:39.254254 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-40c3594b-49f8-48d1-976b-187c794b1846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:26:39.265060 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:39.293890 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 403/809] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jul 26 15:26:39 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:26:39.334312 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 407/810] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:26:39 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 15:26:39.359669 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13043c17-a28e-4e49-a108-b2f713810a29 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:39.487461 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13043c17-a28e-4e49-a108-b2f713810a29 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:39.522440 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:39.536121 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3dbed7-a5dc-4890-b514-a8597ce3964b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:39.538365 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3dbed7-a5dc-4890-b514-a8597ce3964b None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:39.538365 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3dbed7-a5dc-4890-b514-a8597ce3964b None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:39.538365 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3dbed7-a5dc-4890-b514-a8597ce3964b None admin] PATH_INFO: `/v3/services/compute` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:39.538365 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3dbed7-a5dc-4890-b514-a8597ce3964b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:39.539872 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3dbed7-a5dc-4890-b514-a8597ce3964b None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:39.551904 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-1a3dbed7-a5dc-4890-b514-a8597ce3964b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 15:26:39.551904 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:26:39.551904 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 15:26:39.551904 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 15:26:39.551904 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 15:26:39.551904 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 15:26:39.551904 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 15:26:39.551904 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 15:26:39.551904 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 15:26:39.551904 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:26:39.551904 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 15:26:39.551904 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:26:39.551904 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:26:39.551904 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:26:39.551904 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:26:39.551904 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:26:39.551904 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:26:39.554140 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:26:39.554140 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:26:39.554140 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:26:39.554140 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:26:39.554140 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:26:39.554140 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:26:39.554140 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 15:26:39.554140 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 15:26:39.554140 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 15:26:39.554140 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 15:26:39.554140 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:26:39.554140 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:26:39.554140 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:26:39.554140 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:26:39.554140 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:26:39.554140 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:26:39.556341 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:26:39.556341 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:26:39.556341 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:26:39.556341 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:26:39.556341 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:26:39.556341 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:26:39.556341 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:26:39.556341 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:26:39.556341 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:26:39.556341 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:26:39.556341 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 15:26:39.556341 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 15:26:39.556341 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 15:26:39.556341 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:26:39.556341 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 404/811] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 15:26:39 2022] GET /identity/v3/services/compute => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:26:39.563538 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c3594b-49f8-48d1-976b-187c794b1846 None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:39.677234 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c3594b-49f8-48d1-976b-187c794b1846 None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:39.715544 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f841fc5-dbe5-445d-b1fa-819124e28d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:39.716227 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f841fc5-dbe5-445d-b1fa-819124e28d50 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:39.716515 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f841fc5-dbe5-445d-b1fa-819124e28d50 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:39.716795 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f841fc5-dbe5-445d-b1fa-819124e28d50 None admin] PATH_INFO: `/v3/services` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:39.717483 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f841fc5-dbe5-445d-b1fa-819124e28d50 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:26:39.717792 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f841fc5-dbe5-445d-b1fa-819124e28d50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:39.719215 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f841fc5-dbe5-445d-b1fa-819124e28d50 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:39.724195 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 408/812] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Jul 26 15:26:39 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:26:39.730355 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3dbed7-a5dc-4890-b514-a8597ce3964b None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:39.842606 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3dbed7-a5dc-4890-b514-a8597ce3964b None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:39.881490 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b17997-ac1a-4143-a28d-3e901d77beb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:39.882121 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b17997-ac1a-4143-a28d-3e901d77beb8 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:39.882411 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b17997-ac1a-4143-a28d-3e901d77beb8 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:39.882692 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b17997-ac1a-4143-a28d-3e901d77beb8 None admin] PATH_INFO: `/v3/services` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:39.883413 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b17997-ac1a-4143-a28d-3e901d77beb8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:26:39.883748 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b17997-ac1a-4143-a28d-3e901d77beb8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:39.885634 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b17997-ac1a-4143-a28d-3e901d77beb8 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:39.891251 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 405/813] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Jul 26 15:26:39 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:26:39.897445 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f841fc5-dbe5-445d-b1fa-819124e28d50 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:39.909443 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:40.006015 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f841fc5-dbe5-445d-b1fa-819124e28d50 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:40.043335 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9078fd6c-4be2-47c9-b2e6-247552a7d75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:40.044020 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078fd6c-4be2-47c9-b2e6-247552a7d75d None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:40.044351 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078fd6c-4be2-47c9-b2e6-247552a7d75d None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:40.044676 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078fd6c-4be2-47c9-b2e6-247552a7d75d None admin] PATH_INFO: `/v3/endpoints` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:40.045566 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9078fd6c-4be2-47c9-b2e6-247552a7d75d None admin] RBAC: Adding query filter params (interface=public, service_id=9d7ca4af423d414cbfc79c01da006a6d, region_id=RegionOne) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:26:40.045928 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9078fd6c-4be2-47c9-b2e6-247552a7d75d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:40.047470 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9078fd6c-4be2-47c9-b2e6-247552a7d75d None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:40.052996 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 409/814] 10.222.0.18 () {56 vars in 1251 bytes} [Tue Jul 26 15:26:39 2022] GET /identity/v3/endpoints?service_id=9d7ca4af423d414cbfc79c01da006a6d&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:26:40.059516 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b17997-ac1a-4143-a28d-3e901d77beb8 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:40.116028 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:40.198276 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b17997-ac1a-4143-a28d-3e901d77beb8 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:40.258534 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71acde0-dabc-45d9-a961-6e6d90f53b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:40.259702 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71acde0-dabc-45d9-a961-6e6d90f53b8d None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:40.260238 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71acde0-dabc-45d9-a961-6e6d90f53b8d None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:40.260930 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71acde0-dabc-45d9-a961-6e6d90f53b8d None admin] PATH_INFO: `/v3/services` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:40.262073 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71acde0-dabc-45d9-a961-6e6d90f53b8d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:40.264594 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71acde0-dabc-45d9-a961-6e6d90f53b8d None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:40.277791 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 406/815] 10.222.0.18 () {56 vars in 1087 bytes} [Tue Jul 26 15:26:40 2022] GET /identity/v3/services => generated 1728 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:26:42.593273 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1382cf86-7e8c-4e55-8fb6-ce443d4bfcea None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:42.593878 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1382cf86-7e8c-4e55-8fb6-ce443d4bfcea None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:42.593878 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1382cf86-7e8c-4e55-8fb6-ce443d4bfcea None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:42.595190 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 410/816] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:26:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 15:26:42.605321 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c161bafc-f171-4fc5-99b2-42aa94e3ce35 None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:42.605891 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c161bafc-f171-4fc5-99b2-42aa94e3ce35 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:42.606312 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c161bafc-f171-4fc5-99b2-42aa94e3ce35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:42.637554 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-c161bafc-f171-4fc5-99b2-42aa94e3ce35 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:26:42.640366 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-c161bafc-f171-4fc5-99b2-42aa94e3ce35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:26:42.761160 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 407/817] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:26:42 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 15:26:42.785666 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1382cf86-7e8c-4e55-8fb6-ce443d4bfcea None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:42.861747 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:42.894586 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1382cf86-7e8c-4e55-8fb6-ce443d4bfcea None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:42.930002 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d811e-ea43-4b9f-af76-bc837fa1280e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:42.930649 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d811e-ea43-4b9f-af76-bc837fa1280e None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:42.930928 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d811e-ea43-4b9f-af76-bc837fa1280e None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:42.931235 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d811e-ea43-4b9f-af76-bc837fa1280e None admin] PATH_INFO: `/v3/services/compute` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:42.931867 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1d811e-ea43-4b9f-af76-bc837fa1280e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:42.933237 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1d811e-ea43-4b9f-af76-bc837fa1280e None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:42.942471 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application [None req-0c1d811e-ea43-4b9f-af76-bc837fa1280e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 15:26:42.942471 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:26:42.942471 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 15:26:42.942471 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 15:26:42.942471 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 15:26:42.942471 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 15:26:42.942471 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 15:26:42.942471 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 15:26:42.942471 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 15:26:42.942471 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:26:42.942471 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 15:26:42.942471 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:26:42.942471 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:26:42.942471 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:26:42.942471 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:26:42.942471 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:26:42.942471 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:26:42.952505 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:26:42.952505 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:26:42.952505 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:26:42.952505 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:26:42.952505 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:26:42.952505 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:26:42.952505 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 15:26:42.952505 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 15:26:42.952505 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 15:26:42.952505 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 15:26:42.952505 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:26:42.952505 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:26:42.952505 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:26:42.952505 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:26:42.952505 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:26:42.952505 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:26:42.954219 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:26:42.954219 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application with Lock( Jul 26 15:26:42.954219 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:26:42.954219 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:26:42.954219 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:26:42.954219 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:26:42.954219 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:26:42.954219 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:26:42.954219 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:26:42.954219 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:26:42.954219 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 15:26:42.954219 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 15:26:42.954219 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 15:26:42.954219 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:26:42.954219 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 411/818] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 15:26:42 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:26:42.955846 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c161bafc-f171-4fc5-99b2-42aa94e3ce35 None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:43.030180 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:43.084767 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c161bafc-f171-4fc5-99b2-42aa94e3ce35 None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:43.121651 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4013d6-fc0e-4d03-a7c1-e49321641e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:43.122197 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4013d6-fc0e-4d03-a7c1-e49321641e97 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:43.122481 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4013d6-fc0e-4d03-a7c1-e49321641e97 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:43.122756 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4013d6-fc0e-4d03-a7c1-e49321641e97 None admin] PATH_INFO: `/v3/services` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:43.123473 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4013d6-fc0e-4d03-a7c1-e49321641e97 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:26:43.123779 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4013d6-fc0e-4d03-a7c1-e49321641e97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:43.125178 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4013d6-fc0e-4d03-a7c1-e49321641e97 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:43.130276 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 408/819] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Jul 26 15:26:42 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:26:43.140052 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d811e-ea43-4b9f-af76-bc837fa1280e None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:43.244378 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d811e-ea43-4b9f-af76-bc837fa1280e None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:43.283002 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e480313-db14-46f8-9a61-ed0fb614e183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:43.283874 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e480313-db14-46f8-9a61-ed0fb614e183 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:43.284189 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e480313-db14-46f8-9a61-ed0fb614e183 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:43.284532 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e480313-db14-46f8-9a61-ed0fb614e183 None admin] PATH_INFO: `/v3/services` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:43.285282 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e480313-db14-46f8-9a61-ed0fb614e183 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:26:43.285591 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e480313-db14-46f8-9a61-ed0fb614e183 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:43.287049 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e480313-db14-46f8-9a61-ed0fb614e183 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:43.289753 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:43.294199 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 412/820] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Jul 26 15:26:43 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:26:43.300366 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4013d6-fc0e-4d03-a7c1-e49321641e97 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:26:43.423336 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4013d6-fc0e-4d03-a7c1-e49321641e97 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:26:43.434526 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:43.457713 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88db0d08-e5f1-448d-b5bd-7b4e1caba37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:26:43.458335 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db0d08-e5f1-448d-b5bd-7b4e1caba37f None admin] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:26:43.458618 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db0d08-e5f1-448d-b5bd-7b4e1caba37f None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:26:43.458891 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db0d08-e5f1-448d-b5bd-7b4e1caba37f None admin] PATH_INFO: `/v3/endpoints` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:26:43.459633 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88db0d08-e5f1-448d-b5bd-7b4e1caba37f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:26:43.461039 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88db0d08-e5f1-448d-b5bd-7b4e1caba37f None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:26:43.537045 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 409/821] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Jul 26 15:26:43 2022] POST /identity/v3/endpoints => generated 334 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:26:53.532333 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=16,keystone:INSERT=1 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:08.952872 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a55e84b-9dc7-4c6d-88f2-e6bd67e27d6f None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:08.953429 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a55e84b-9dc7-4c6d-88f2-e6bd67e27d6f None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:08.953429 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a55e84b-9dc7-4c6d-88f2-e6bd67e27d6f None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:08.954848 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 413/822] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:28:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:28:08.960863 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350cb542-3570-4ffa-a1e4-6b92016ac1d5 None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:08.966417 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350cb542-3570-4ffa-a1e4-6b92016ac1d5 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:08.966417 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350cb542-3570-4ffa-a1e4-6b92016ac1d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:08.981932 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-350cb542-3570-4ffa-a1e4-6b92016ac1d5 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:28:08.983178 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-350cb542-3570-4ffa-a1e4-6b92016ac1d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:28:09.058610 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 410/823] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:28:08 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 15:28:09.084996 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a55e84b-9dc7-4c6d-88f2-e6bd67e27d6f None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:09.192522 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a55e84b-9dc7-4c6d-88f2-e6bd67e27d6f None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:09.225992 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c573fa-2a60-4031-9778-fb70fcab425e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:09.226638 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c573fa-2a60-4031-9778-fb70fcab425e None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:09.226918 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c573fa-2a60-4031-9778-fb70fcab425e None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:09.227224 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c573fa-2a60-4031-9778-fb70fcab425e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:09.237836 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c573fa-2a60-4031-9778-fb70fcab425e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:09.240090 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c573fa-2a60-4031-9778-fb70fcab425e None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:09.254059 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application [None req-44c573fa-2a60-4031-9778-fb70fcab425e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:28:09.254059 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:28:09.254059 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:28:09.254059 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:28:09.254059 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:28:09.254059 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:28:09.254059 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:28:09.254059 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:28:09.254059 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:28:09.254059 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:28:09.254059 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:28:09.254059 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:28:09.254059 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:28:09.254059 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:28:09.254059 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:28:09.255692 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:28:09.255692 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:28:09.255692 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:28:09.255692 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:28:09.255692 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:28:09.255692 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:28:09.255692 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:28:09.255692 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:28:09.255692 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application with Lock( Jul 26 15:28:09.255692 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:28:09.255692 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:28:09.255692 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:28:09.255692 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:28:09.255692 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:28:09.255692 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:28:09.255692 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:28:09.255692 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:28:09.256752 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:28:09.256752 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:28:09.256752 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:28:09.256752 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:28:09.256752 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 414/824] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 15:28:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:28:09.262038 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350cb542-3570-4ffa-a1e4-6b92016ac1d5 None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:09.361542 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350cb542-3570-4ffa-a1e4-6b92016ac1d5 None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:09.388401 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:09.398039 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33c17c8-195d-463c-a6fc-96fc9f802fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:09.398659 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c17c8-195d-463c-a6fc-96fc9f802fa6 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:09.398944 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c17c8-195d-463c-a6fc-96fc9f802fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:09.399251 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c17c8-195d-463c-a6fc-96fc9f802fa6 None admin] PATH_INFO: `/v3/domains` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:09.399944 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33c17c8-195d-463c-a6fc-96fc9f802fa6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:28:09.400253 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33c17c8-195d-463c-a6fc-96fc9f802fa6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:09.401665 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33c17c8-195d-463c-a6fc-96fc9f802fa6 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:09.412771 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 411/825] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 15:28:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:28:09.419178 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c573fa-2a60-4031-9778-fb70fcab425e None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:09.472355 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:09.519019 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c573fa-2a60-4031-9778-fb70fcab425e None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:09.556597 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bd4f5a-6c8f-407c-a77e-0356a31792ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:09.557219 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd4f5a-6c8f-407c-a77e-0356a31792ab None admin] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:09.557500 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd4f5a-6c8f-407c-a77e-0356a31792ab None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:09.557772 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd4f5a-6c8f-407c-a77e-0356a31792ab None admin] PATH_INFO: `/v3/users` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:09.558452 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bd4f5a-6c8f-407c-a77e-0356a31792ab None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:09.559915 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bd4f5a-6c8f-407c-a77e-0356a31792ab None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:09.785464 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 415/826] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Jul 26 15:28:09 2022] POST /identity/v3/users => generated 251 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:28:12.116974 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e14ea88-0a15-4e56-b089-445351282db0 None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:12.117519 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e14ea88-0a15-4e56-b089-445351282db0 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:12.117519 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e14ea88-0a15-4e56-b089-445351282db0 None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:12.118875 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 412/827] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:28:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:28:12.124250 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa1ed36-5a9d-493c-a15f-71b0a46e5fd1 None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:12.124742 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa1ed36-5a9d-493c-a15f-71b0a46e5fd1 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:12.124839 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa1ed36-5a9d-493c-a15f-71b0a46e5fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:12.143563 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-bfa1ed36-5a9d-493c-a15f-71b0a46e5fd1 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:28:12.154083 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-bfa1ed36-5a9d-493c-a15f-71b0a46e5fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:28:12.213599 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 416/828] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:28:12 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 15:28:12.237914 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e14ea88-0a15-4e56-b089-445351282db0 None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:12.349312 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e14ea88-0a15-4e56-b089-445351282db0 None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:12.383471 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484bffda-e45a-4a79-9dbf-eae86c6132f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:12.384151 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484bffda-e45a-4a79-9dbf-eae86c6132f3 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:12.384437 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484bffda-e45a-4a79-9dbf-eae86c6132f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:12.384716 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484bffda-e45a-4a79-9dbf-eae86c6132f3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:12.396030 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484bffda-e45a-4a79-9dbf-eae86c6132f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:28:12.402718 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-484bffda-e45a-4a79-9dbf-eae86c6132f3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 15:28:12.402718 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:28:12.402718 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:28:12.402718 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:28:12.402718 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:28:12.402718 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:28:12.402718 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:28:12.402718 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:28:12.402718 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:28:12.402718 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:28:12.402718 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:28:12.402718 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:28:12.402718 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:28:12.402718 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:28:12.402718 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:28:12.402718 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:28:12.403855 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:28:12.403855 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:28:12.403855 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:28:12.403855 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:28:12.403855 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:28:12.403855 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:28:12.403855 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:28:12.403855 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:28:12.403855 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:28:12.403855 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:28:12.403855 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:28:12.403855 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:28:12.403855 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:28:12.403855 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:28:12.403855 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:28:12.403855 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:28:12.404772 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:28:12.404772 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:28:12.404772 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:28:12.404772 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:28:12.404772 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:28:12.404772 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:28:12.404772 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:28:12.404772 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:28:12.404772 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:28:12.404772 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:28:12.404772 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 15:28:12.404772 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:28:12.404772 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 413/829] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jul 26 15:28:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:28:12.410639 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa1ed36-5a9d-493c-a15f-71b0a46e5fd1 None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:12.452135 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:12.524856 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa1ed36-5a9d-493c-a15f-71b0a46e5fd1 None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:12.562960 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54afca9c-1000-4e3d-9dab-b90969488f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:12.563615 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54afca9c-1000-4e3d-9dab-b90969488f64 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:12.563902 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54afca9c-1000-4e3d-9dab-b90969488f64 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:12.564177 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54afca9c-1000-4e3d-9dab-b90969488f64 None admin] PATH_INFO: `/v3/roles` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:12.564893 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54afca9c-1000-4e3d-9dab-b90969488f64 None admin] RBAC: Adding query filter params (name=service) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:28:12.565203 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54afca9c-1000-4e3d-9dab-b90969488f64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:12.566609 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54afca9c-1000-4e3d-9dab-b90969488f64 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:12.577216 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 417/830] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jul 26 15:28:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:28:12.583731 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484bffda-e45a-4a79-9dbf-eae86c6132f3 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:12.634706 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:12.692046 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484bffda-e45a-4a79-9dbf-eae86c6132f3 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:12.726485 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be611eb-2fa0-43d4-b05f-6040b892b4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:12.727150 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be611eb-2fa0-43d4-b05f-6040b892b4df None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:12.727448 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be611eb-2fa0-43d4-b05f-6040b892b4df None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:12.727729 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be611eb-2fa0-43d4-b05f-6040b892b4df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:12.738571 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be611eb-2fa0-43d4-b05f-6040b892b4df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:12.740121 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be611eb-2fa0-43d4-b05f-6040b892b4df None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:12.754634 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-7be611eb-2fa0-43d4-b05f-6040b892b4df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:28:12.754634 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:28:12.754634 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:28:12.754634 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:28:12.754634 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:28:12.754634 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:28:12.754634 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:28:12.754634 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:28:12.754634 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:28:12.754634 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:28:12.754634 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:28:12.754634 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:28:12.754634 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:28:12.754634 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:28:12.754634 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:28:12.755798 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:28:12.755798 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:28:12.755798 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:28:12.755798 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:28:12.755798 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:28:12.755798 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:28:12.755798 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:28:12.755798 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:28:12.755798 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:28:12.755798 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:28:12.755798 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:28:12.755798 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:28:12.755798 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:28:12.755798 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:28:12.755798 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:28:12.755798 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:28:12.755798 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:28:12.757099 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:28:12.757099 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:28:12.757099 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:28:12.757099 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:28:12.757099 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 414/831] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 15:28:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:28:12.761779 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54afca9c-1000-4e3d-9dab-b90969488f64 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:12.863958 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:12.866820 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54afca9c-1000-4e3d-9dab-b90969488f64 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:12.903572 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fe97d1-a098-415f-90a5-c5bfde6c6d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:12.904227 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe97d1-a098-415f-90a5-c5bfde6c6d43 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:12.904514 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe97d1-a098-415f-90a5-c5bfde6c6d43 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:12.904792 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe97d1-a098-415f-90a5-c5bfde6c6d43 None admin] PATH_INFO: `/v3/domains` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:12.905518 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fe97d1-a098-415f-90a5-c5bfde6c6d43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:28:12.905820 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fe97d1-a098-415f-90a5-c5bfde6c6d43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:12.907454 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fe97d1-a098-415f-90a5-c5bfde6c6d43 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:12.922391 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 418/832] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 15:28:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:28:12.928378 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be611eb-2fa0-43d4-b05f-6040b892b4df None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:13.040688 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:13.045043 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be611eb-2fa0-43d4-b05f-6040b892b4df None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:13.089404 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb513b9-0569-4901-a8b0-20c29760a0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:13.090055 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb513b9-0569-4901-a8b0-20c29760a0b4 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:13.090341 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb513b9-0569-4901-a8b0-20c29760a0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:13.090620 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb513b9-0569-4901-a8b0-20c29760a0b4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:13.098863 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb513b9-0569-4901-a8b0-20c29760a0b4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:13.100414 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb513b9-0569-4901-a8b0-20c29760a0b4 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:13.111911 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-8cb513b9-0569-4901-a8b0-20c29760a0b4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 26 15:28:13.111911 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:28:13.111911 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:28:13.111911 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:28:13.111911 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:28:13.111911 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:28:13.111911 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:28:13.111911 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:28:13.111911 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:28:13.111911 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:28:13.111911 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:28:13.111911 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:28:13.111911 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 15:28:13.111911 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 15:28:13.111911 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 15:28:13.111911 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 15:28:13.113083 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:28:13.113083 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:28:13.113083 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 15:28:13.113083 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:28:13.113083 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 15:28:13.113083 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:28:13.113083 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:28:13.113083 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:28:13.113083 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:28:13.113083 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:28:13.113083 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:28:13.113083 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:28:13.113083 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:28:13.113083 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:28:13.113083 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:28:13.113083 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:28:13.113083 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:28:13.113083 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:28:13.114559 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:28:13.114559 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:28:13.114559 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 15:28:13.114559 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 15:28:13.114559 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 15:28:13.114559 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 15:28:13.114559 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 15:28:13.114559 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 15:28:13.114559 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 26 15:28:13.114559 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:28:13.114559 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 415/833] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 15:28:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:28:13.119385 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fe97d1-a098-415f-90a5-c5bfde6c6d43 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:13.223406 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fe97d1-a098-415f-90a5-c5bfde6c6d43 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:13.263189 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f7fde3-13f5-4a5d-9289-753c7a4a0e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:13.263873 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f7fde3-13f5-4a5d-9289-753c7a4a0e1b None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:13.264110 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f7fde3-13f5-4a5d-9289-753c7a4a0e1b None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:13.264385 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f7fde3-13f5-4a5d-9289-753c7a4a0e1b None admin] PATH_INFO: `/v3/users` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:13.265191 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f7fde3-13f5-4a5d-9289-753c7a4a0e1b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:28:13.265503 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f7fde3-13f5-4a5d-9289-753c7a4a0e1b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:13.266963 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f7fde3-13f5-4a5d-9289-753c7a4a0e1b None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:13.285287 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 419/834] 10.222.0.18 () {56 vars in 1143 bytes} [Tue Jul 26 15:28:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:28:13.291327 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb513b9-0569-4901-a8b0-20c29760a0b4 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:13.396362 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb513b9-0569-4901-a8b0-20c29760a0b4 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:13.430803 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d652b3-083a-40ef-ba2e-4c454a7cfa18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:13.431449 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d652b3-083a-40ef-ba2e-4c454a7cfa18 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:13.431729 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d652b3-083a-40ef-ba2e-4c454a7cfa18 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:13.432001 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d652b3-083a-40ef-ba2e-4c454a7cfa18 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:13.458947 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:13.499341 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d652b3-083a-40ef-ba2e-4c454a7cfa18 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:13.500834 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d652b3-083a-40ef-ba2e-4c454a7cfa18 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:13.609853 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 416/835] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 15:28:13 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 15:28:13.616582 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f7fde3-13f5-4a5d-9289-753c7a4a0e1b None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:13.638143 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:13.730455 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f7fde3-13f5-4a5d-9289-753c7a4a0e1b None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:13.769731 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c4748-0f9f-4eca-b14c-8403e70e516b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:13.770946 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c4748-0f9f-4eca-b14c-8403e70e516b None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:13.771298 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c4748-0f9f-4eca-b14c-8403e70e516b None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:13.771588 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c4748-0f9f-4eca-b14c-8403e70e516b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:13.782605 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615c4748-0f9f-4eca-b14c-8403e70e516b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:13.784108 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615c4748-0f9f-4eca-b14c-8403e70e516b None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:13.800329 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application [None req-615c4748-0f9f-4eca-b14c-8403e70e516b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:28:13.800329 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:28:13.800329 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:28:13.800329 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:28:13.800329 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:28:13.800329 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:28:13.800329 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:28:13.800329 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:28:13.800329 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:28:13.800329 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:28:13.800329 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:28:13.800329 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:28:13.800329 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:28:13.800329 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:28:13.800329 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:28:13.807015 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:28:13.807015 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:28:13.807015 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:28:13.807015 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:28:13.807015 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:28:13.807015 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:28:13.807015 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:28:13.807015 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:28:13.807015 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application with Lock( Jul 26 15:28:13.807015 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:28:13.807015 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:28:13.807015 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:28:13.807015 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:28:13.807015 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:28:13.807015 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:28:13.807015 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:28:13.807015 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:28:13.807948 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:28:13.807948 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:28:13.807948 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:28:13.807948 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:28:13.807948 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 420/836] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 15:28:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:28:13.808321 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d652b3-083a-40ef-ba2e-4c454a7cfa18 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:13.869272 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:13.911312 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d652b3-083a-40ef-ba2e-4c454a7cfa18 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:13.946216 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c306a3-7bda-4d20-b413-f5481f56858e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:13.946847 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c306a3-7bda-4d20-b413-f5481f56858e None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:13.947151 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c306a3-7bda-4d20-b413-f5481f56858e None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:13.947446 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c306a3-7bda-4d20-b413-f5481f56858e None admin] PATH_INFO: `/v3/domains` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:13.948147 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c306a3-7bda-4d20-b413-f5481f56858e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:28:13.948456 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c306a3-7bda-4d20-b413-f5481f56858e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:13.949859 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c306a3-7bda-4d20-b413-f5481f56858e None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:13.961678 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 417/837] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 15:28:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:28:13.967451 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c4748-0f9f-4eca-b14c-8403e70e516b None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:14.038183 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:14.069320 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c4748-0f9f-4eca-b14c-8403e70e516b None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:14.101095 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88945f3-e8a2-43ae-8c0f-a6833d660781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:14.101722 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88945f3-e8a2-43ae-8c0f-a6833d660781 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:14.102004 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88945f3-e8a2-43ae-8c0f-a6833d660781 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:14.102271 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88945f3-e8a2-43ae-8c0f-a6833d660781 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:14.108735 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88945f3-e8a2-43ae-8c0f-a6833d660781 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:14.110235 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88945f3-e8a2-43ae-8c0f-a6833d660781 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:14.121941 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application [None req-f88945f3-e8a2-43ae-8c0f-a6833d660781 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:28:14.121941 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:28:14.121941 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:28:14.121941 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:28:14.121941 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:28:14.121941 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:28:14.121941 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:28:14.121941 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:28:14.121941 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:28:14.121941 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:28:14.121941 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:28:14.121941 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:28:14.121941 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 15:28:14.121941 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 15:28:14.121941 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 15:28:14.122989 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 15:28:14.122989 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:28:14.122989 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:28:14.122989 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:28:14.122989 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:28:14.122989 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:28:14.122989 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:28:14.122989 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:28:14.122989 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application with Lock( Jul 26 15:28:14.122989 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:28:14.122989 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:28:14.122989 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:28:14.122989 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:28:14.122989 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:28:14.122989 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:28:14.122989 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:28:14.122989 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:28:14.124285 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 15:28:14.124285 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 15:28:14.124285 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 15:28:14.124285 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 15:28:14.124285 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 15:28:14.124285 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 15:28:14.124285 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:28:14.124285 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:28:14.124285 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 421/838] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 15:28:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 15:28:14.129029 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c306a3-7bda-4d20-b413-f5481f56858e None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:14.230827 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c306a3-7bda-4d20-b413-f5481f56858e None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:14.248459 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:14.266379 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f560c-32a6-44a5-a292-d96f8490d4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:14.267052 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f560c-32a6-44a5-a292-d96f8490d4f9 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:14.267373 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f560c-32a6-44a5-a292-d96f8490d4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:14.267654 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f560c-32a6-44a5-a292-d96f8490d4f9 None admin] PATH_INFO: `/v3/projects` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:14.268403 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8f560c-32a6-44a5-a292-d96f8490d4f9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:28:14.268717 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8f560c-32a6-44a5-a292-d96f8490d4f9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:14.270240 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8f560c-32a6-44a5-a292-d96f8490d4f9 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:14.282337 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 418/839] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jul 26 15:28:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:28:14.288632 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88945f3-e8a2-43ae-8c0f-a6833d660781 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:14.389530 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88945f3-e8a2-43ae-8c0f-a6833d660781 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:14.419871 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:14.425731 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71fca04-af14-42a8-a188-733b514e48a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:14.426960 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71fca04-af14-42a8-a188-733b514e48a8 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:14.427350 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71fca04-af14-42a8-a188-733b514e48a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:14.427722 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71fca04-af14-42a8-a188-733b514e48a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:14.428523 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71fca04-af14-42a8-a188-733b514e48a8 None admin] RBAC: Adding query filter params (role.id=2a6f012a2a004fbb8ab4d8a5f8633a22, scope.project.id=9178e468facc41d6a7d828dfcd5301b4, user.id=21a7f59ebf1b40a1b76ee2002ae38230) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:28:14.428930 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71fca04-af14-42a8-a188-733b514e48a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:14.430342 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71fca04-af14-42a8-a188-733b514e48a8 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:14.436080 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 422/840] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 26 15:28:14 2022] GET /identity/v3/role_assignments?user.id=21a7f59ebf1b40a1b76ee2002ae38230&scope.project.id=9178e468facc41d6a7d828dfcd5301b4&role.id=2a6f012a2a004fbb8ab4d8a5f8633a22 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:28:16.719087 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ceb495-9359-4f68-ad92-ec5db57aa929 None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:16.719708 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ceb495-9359-4f68-ad92-ec5db57aa929 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:16.719708 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ceb495-9359-4f68-ad92-ec5db57aa929 None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:16.721173 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 419/841] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:28:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:28:16.726936 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2578c6-5376-45a8-977a-f10ca8b67114 None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:16.727422 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2578c6-5376-45a8-977a-f10ca8b67114 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:16.727534 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2578c6-5376-45a8-977a-f10ca8b67114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:16.746367 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-ea2578c6-5376-45a8-977a-f10ca8b67114 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:28:16.747611 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-ea2578c6-5376-45a8-977a-f10ca8b67114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:28:16.818689 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 423/842] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:28:16 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 15:28:16.843057 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ceb495-9359-4f68-ad92-ec5db57aa929 None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:16.954991 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ceb495-9359-4f68-ad92-ec5db57aa929 None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:16.995423 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c34fb-d7df-455b-836d-71696016db8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:16.995993 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c34fb-d7df-455b-836d-71696016db8b None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:16.996277 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c34fb-d7df-455b-836d-71696016db8b None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:16.996558 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c34fb-d7df-455b-836d-71696016db8b None admin] PATH_INFO: `/v3/roles/service` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:17.007406 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3c34fb-d7df-455b-836d-71696016db8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:28:17.012350 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-ca3c34fb-d7df-455b-836d-71696016db8b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 15:28:17.012350 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:28:17.012350 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:28:17.012350 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:28:17.012350 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:28:17.012350 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:28:17.012350 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:28:17.012350 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:28:17.012350 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:28:17.012350 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:28:17.012350 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:28:17.012350 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:28:17.012350 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:28:17.012350 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:28:17.012350 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:28:17.012350 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:28:17.013558 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:28:17.013558 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:28:17.013558 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:28:17.013558 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:28:17.013558 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:28:17.013558 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:28:17.013558 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:28:17.013558 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:28:17.013558 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:28:17.013558 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:28:17.013558 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:28:17.013558 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:28:17.013558 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:28:17.013558 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:28:17.013558 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:28:17.013558 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:28:17.014502 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:28:17.014502 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:28:17.014502 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:28:17.014502 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:28:17.014502 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:28:17.014502 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:28:17.014502 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:28:17.014502 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:28:17.014502 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:28:17.014502 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:28:17.014502 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 15:28:17.014502 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:28:17.014502 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 420/843] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jul 26 15:28:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:28:17.019640 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2578c6-5376-45a8-977a-f10ca8b67114 None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:17.118731 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2578c6-5376-45a8-977a-f10ca8b67114 None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:17.148272 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:17.160443 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa030c69-21c7-4434-989b-c230983bbb8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:17.161099 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa030c69-21c7-4434-989b-c230983bbb8e None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:17.161384 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa030c69-21c7-4434-989b-c230983bbb8e None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:17.161664 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa030c69-21c7-4434-989b-c230983bbb8e None admin] PATH_INFO: `/v3/roles` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:17.162407 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa030c69-21c7-4434-989b-c230983bbb8e None admin] RBAC: Adding query filter params (name=service) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:28:17.162716 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa030c69-21c7-4434-989b-c230983bbb8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:17.164189 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa030c69-21c7-4434-989b-c230983bbb8e None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:17.173751 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 424/844] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jul 26 15:28:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:28:17.180520 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c34fb-d7df-455b-836d-71696016db8b None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:17.224255 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:17.293749 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c34fb-d7df-455b-836d-71696016db8b None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:17.333343 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee391ce-173c-411d-9d4f-e38de1e2cc54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:17.334001 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee391ce-173c-411d-9d4f-e38de1e2cc54 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:17.334283 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee391ce-173c-411d-9d4f-e38de1e2cc54 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:17.334555 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee391ce-173c-411d-9d4f-e38de1e2cc54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:17.345501 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee391ce-173c-411d-9d4f-e38de1e2cc54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:17.347047 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee391ce-173c-411d-9d4f-e38de1e2cc54 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:17.362904 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-9ee391ce-173c-411d-9d4f-e38de1e2cc54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:28:17.362904 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:28:17.362904 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:28:17.362904 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:28:17.362904 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:28:17.362904 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:28:17.362904 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:28:17.362904 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:28:17.362904 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:28:17.362904 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:28:17.362904 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:28:17.362904 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:28:17.362904 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:28:17.362904 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:28:17.362904 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:28:17.364157 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:28:17.364157 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:28:17.364157 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:28:17.364157 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:28:17.364157 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:28:17.364157 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:28:17.364157 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:28:17.364157 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:28:17.364157 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:28:17.364157 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:28:17.364157 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:28:17.364157 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:28:17.364157 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:28:17.364157 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:28:17.364157 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:28:17.364157 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:28:17.364157 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:28:17.370064 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:28:17.370064 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:28:17.370064 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:28:17.370064 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:28:17.370064 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 421/845] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 15:28:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:28:17.370530 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa030c69-21c7-4434-989b-c230983bbb8e None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:17.476923 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa030c69-21c7-4434-989b-c230983bbb8e None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:17.511218 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91525574-af47-46d0-9995-3a44a717c231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:17.511880 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91525574-af47-46d0-9995-3a44a717c231 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:17.512215 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91525574-af47-46d0-9995-3a44a717c231 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:17.512489 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91525574-af47-46d0-9995-3a44a717c231 None admin] PATH_INFO: `/v3/domains` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:17.513189 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91525574-af47-46d0-9995-3a44a717c231 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:28:17.513497 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91525574-af47-46d0-9995-3a44a717c231 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:17.514864 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91525574-af47-46d0-9995-3a44a717c231 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:17.527378 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 425/846] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 15:28:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:28:17.533603 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee391ce-173c-411d-9d4f-e38de1e2cc54 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:17.627919 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:17.637478 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee391ce-173c-411d-9d4f-e38de1e2cc54 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:17.671234 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa1d58b-ea32-4b16-9a77-a40ac48f7be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:17.671881 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1d58b-ea32-4b16-9a77-a40ac48f7be0 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:17.672170 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1d58b-ea32-4b16-9a77-a40ac48f7be0 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:17.672526 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1d58b-ea32-4b16-9a77-a40ac48f7be0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:17.680492 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa1d58b-ea32-4b16-9a77-a40ac48f7be0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:17.681969 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa1d58b-ea32-4b16-9a77-a40ac48f7be0 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:17.693900 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-efa1d58b-ea32-4b16-9a77-a40ac48f7be0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 26 15:28:17.693900 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:28:17.693900 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:28:17.693900 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:28:17.693900 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:28:17.693900 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:28:17.693900 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:28:17.693900 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:28:17.693900 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:28:17.693900 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:28:17.693900 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:28:17.693900 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:28:17.693900 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 15:28:17.693900 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 15:28:17.693900 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 15:28:17.693900 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 15:28:17.695013 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:28:17.695013 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:28:17.695013 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 15:28:17.695013 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:28:17.695013 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 15:28:17.695013 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:28:17.695013 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:28:17.695013 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:28:17.695013 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:28:17.695013 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:28:17.695013 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:28:17.695013 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:28:17.695013 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:28:17.695013 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:28:17.695013 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:28:17.695013 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:28:17.695013 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:28:17.695013 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:28:17.696268 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:28:17.696268 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:28:17.696268 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 15:28:17.696268 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 15:28:17.696268 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 15:28:17.696268 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 15:28:17.696268 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 15:28:17.696268 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 15:28:17.696268 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 26 15:28:17.696268 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:28:17.696268 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 422/847] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 15:28:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:28:17.701168 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91525574-af47-46d0-9995-3a44a717c231 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:17.749968 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:17.803378 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91525574-af47-46d0-9995-3a44a717c231 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:17.841089 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087c284c-5bfa-49aa-9e5b-4ae3c0a3b51a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:17.841716 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087c284c-5bfa-49aa-9e5b-4ae3c0a3b51a None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:17.841994 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087c284c-5bfa-49aa-9e5b-4ae3c0a3b51a None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:17.842267 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087c284c-5bfa-49aa-9e5b-4ae3c0a3b51a None admin] PATH_INFO: `/v3/users` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:17.843064 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087c284c-5bfa-49aa-9e5b-4ae3c0a3b51a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:28:17.843404 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087c284c-5bfa-49aa-9e5b-4ae3c0a3b51a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:17.844839 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087c284c-5bfa-49aa-9e5b-4ae3c0a3b51a None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:17.862808 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 426/848] 10.222.0.18 () {56 vars in 1143 bytes} [Tue Jul 26 15:28:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:28:17.868664 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa1d58b-ea32-4b16-9a77-a40ac48f7be0 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:17.970775 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa1d58b-ea32-4b16-9a77-a40ac48f7be0 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:18.005406 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f164f11e-2179-4603-8d60-9cb822a7e560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:18.006058 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f164f11e-2179-4603-8d60-9cb822a7e560 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:18.006407 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f164f11e-2179-4603-8d60-9cb822a7e560 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:18.006688 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f164f11e-2179-4603-8d60-9cb822a7e560 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:18.017765 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f164f11e-2179-4603-8d60-9cb822a7e560 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:18.019273 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f164f11e-2179-4603-8d60-9cb822a7e560 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:18.033976 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-f164f11e-2179-4603-8d60-9cb822a7e560 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:28:18.033976 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:28:18.033976 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:28:18.033976 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:28:18.033976 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:28:18.033976 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:28:18.033976 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:28:18.033976 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:28:18.033976 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:28:18.033976 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:28:18.033976 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:28:18.033976 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:28:18.033976 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:28:18.033976 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:28:18.033976 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:28:18.035074 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:28:18.035074 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:28:18.035074 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:28:18.035074 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:28:18.035074 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:28:18.035074 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:28:18.035074 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:28:18.035074 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:28:18.035074 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:28:18.035074 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:28:18.035074 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:28:18.035074 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:28:18.035074 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:28:18.035074 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:28:18.035074 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:28:18.035074 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:28:18.035074 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:28:18.036336 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:28:18.036336 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:28:18.036336 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:28:18.036336 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:28:18.036336 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 423/849] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 15:28:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:28:18.040983 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087c284c-5bfa-49aa-9e5b-4ae3c0a3b51a None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:18.141220 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087c284c-5bfa-49aa-9e5b-4ae3c0a3b51a None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:18.143559 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:18.179417 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4921c159-036b-4992-8398-2ebaff095db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:18.180050 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4921c159-036b-4992-8398-2ebaff095db2 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:18.180336 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4921c159-036b-4992-8398-2ebaff095db2 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:18.180615 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4921c159-036b-4992-8398-2ebaff095db2 None admin] PATH_INFO: `/v3/domains` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:18.181366 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4921c159-036b-4992-8398-2ebaff095db2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:28:18.181625 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4921c159-036b-4992-8398-2ebaff095db2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:18.183017 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4921c159-036b-4992-8398-2ebaff095db2 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:18.195204 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 427/850] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 15:28:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:28:18.201212 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f164f11e-2179-4603-8d60-9cb822a7e560 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:18.204421 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:18.306847 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f164f11e-2179-4603-8d60-9cb822a7e560 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:18.341136 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb90c52c-2d48-4bee-8c76-6cf0e028d148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:18.341812 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb90c52c-2d48-4bee-8c76-6cf0e028d148 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:18.342308 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb90c52c-2d48-4bee-8c76-6cf0e028d148 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:18.342639 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb90c52c-2d48-4bee-8c76-6cf0e028d148 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:18.350733 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb90c52c-2d48-4bee-8c76-6cf0e028d148 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:18.352284 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb90c52c-2d48-4bee-8c76-6cf0e028d148 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:18.365058 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-eb90c52c-2d48-4bee-8c76-6cf0e028d148 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:28:18.365058 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:28:18.365058 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:28:18.365058 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:28:18.365058 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:28:18.365058 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:28:18.365058 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:28:18.365058 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:28:18.365058 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:28:18.365058 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:28:18.365058 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:28:18.365058 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:28:18.365058 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 15:28:18.365058 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 15:28:18.365058 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 15:28:18.367316 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 15:28:18.367316 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:28:18.367316 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:28:18.367316 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:28:18.367316 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:28:18.367316 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:28:18.367316 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:28:18.367316 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:28:18.367316 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:28:18.367316 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:28:18.367316 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:28:18.367316 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:28:18.367316 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:28:18.367316 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:28:18.367316 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:28:18.367316 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:28:18.367316 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:28:18.368337 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 15:28:18.368337 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 15:28:18.368337 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 15:28:18.368337 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 15:28:18.368337 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 15:28:18.368337 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 15:28:18.368337 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:28:18.368337 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:28:18.368337 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 424/851] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 15:28:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:28:18.372004 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4921c159-036b-4992-8398-2ebaff095db2 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:18.475147 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4921c159-036b-4992-8398-2ebaff095db2 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:18.508886 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d05bf3-e6c3-4e60-b4d1-6640f9e26831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:18.509523 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d05bf3-e6c3-4e60-b4d1-6640f9e26831 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:18.509809 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d05bf3-e6c3-4e60-b4d1-6640f9e26831 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:18.510090 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d05bf3-e6c3-4e60-b4d1-6640f9e26831 None admin] PATH_INFO: `/v3/projects` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:18.510952 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d05bf3-e6c3-4e60-b4d1-6640f9e26831 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:28:18.511296 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d05bf3-e6c3-4e60-b4d1-6640f9e26831 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:18.512710 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d05bf3-e6c3-4e60-b4d1-6640f9e26831 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:18.525701 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 428/852] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jul 26 15:28:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:28:18.531908 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb90c52c-2d48-4bee-8c76-6cf0e028d148 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:18.603884 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:18.643565 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb90c52c-2d48-4bee-8c76-6cf0e028d148 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:18.686754 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f93fd3-86e8-4fa8-8232-94adbf846ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:18.687454 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f93fd3-86e8-4fa8-8232-94adbf846ec1 None admin] REQUEST_METHOD: `PUT` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:18.687739 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f93fd3-86e8-4fa8-8232-94adbf846ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:18.688020 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f93fd3-86e8-4fa8-8232-94adbf846ec1 None admin] PATH_INFO: `/v3/projects/9178e468facc41d6a7d828dfcd5301b4/users/21a7f59ebf1b40a1b76ee2002ae38230/roles/2a6f012a2a004fbb8ab4d8a5f8633a22` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:18.703465 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f93fd3-86e8-4fa8-8232-94adbf846ec1 None admin] RBAC: Authorizing `identity:create_grant(project_id=9178e468facc41d6a7d828dfcd5301b4, user_id=21a7f59ebf1b40a1b76ee2002ae38230, role_id=2a6f012a2a004fbb8ab4d8a5f8633a22)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:18.704948 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f93fd3-86e8-4fa8-8232-94adbf846ec1 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:18.804226 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 425/853] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jul 26 15:28:18 2022] PUT /identity/v3/projects/9178e468facc41d6a7d828dfcd5301b4/users/21a7f59ebf1b40a1b76ee2002ae38230/roles/2a6f012a2a004fbb8ab4d8a5f8633a22 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:28:21.034632 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd72acc4-a825-448e-81b8-98117f4ac2f5 None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:21.035275 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd72acc4-a825-448e-81b8-98117f4ac2f5 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:21.035875 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd72acc4-a825-448e-81b8-98117f4ac2f5 None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:21.037186 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 429/854] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:28:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:28:21.042961 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd9a86-71ae-4a19-b2d2-3fceb9b268e1 None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:21.043426 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd9a86-71ae-4a19-b2d2-3fceb9b268e1 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:21.043558 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd9a86-71ae-4a19-b2d2-3fceb9b268e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:21.062471 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-42dd9a86-71ae-4a19-b2d2-3fceb9b268e1 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:28:21.063764 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-42dd9a86-71ae-4a19-b2d2-3fceb9b268e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:28:21.134616 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 426/855] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:28:21 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 15:28:21.160818 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd72acc4-a825-448e-81b8-98117f4ac2f5 None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:21.186043 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:21.267706 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd72acc4-a825-448e-81b8-98117f4ac2f5 None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:21.306020 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0b6131-d5d2-4946-929a-e9312240321b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:21.306682 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b6131-d5d2-4946-929a-e9312240321b None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:21.306963 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b6131-d5d2-4946-929a-e9312240321b None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:21.307270 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b6131-d5d2-4946-929a-e9312240321b None admin] PATH_INFO: `/v3/roles/service` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:21.322741 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0b6131-d5d2-4946-929a-e9312240321b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:28:21.327993 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application [None req-1d0b6131-d5d2-4946-929a-e9312240321b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 15:28:21.327993 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:28:21.327993 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:28:21.327993 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:28:21.327993 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:28:21.327993 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:28:21.327993 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:28:21.327993 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:28:21.327993 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:28:21.327993 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:28:21.327993 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:28:21.327993 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:28:21.327993 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:28:21.327993 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:28:21.327993 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:28:21.327993 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:28:21.329269 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:28:21.329269 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:28:21.329269 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:28:21.329269 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:28:21.329269 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:28:21.329269 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:28:21.329269 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:28:21.329269 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:28:21.329269 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:28:21.329269 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:28:21.329269 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:28:21.329269 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application with Lock( Jul 26 15:28:21.329269 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:28:21.329269 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:28:21.329269 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:28:21.329269 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:28:21.330269 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:28:21.330269 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:28:21.330269 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:28:21.330269 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:28:21.330269 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:28:21.330269 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:28:21.330269 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:28:21.330269 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:28:21.330269 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:28:21.330269 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:28:21.330269 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 15:28:21.330269 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:28:21.330269 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 430/856] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jul 26 15:28:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:28:21.336272 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dd9a86-71ae-4a19-b2d2-3fceb9b268e1 None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:21.386055 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:21.452491 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dd9a86-71ae-4a19-b2d2-3fceb9b268e1 None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:21.482679 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd81afd-9043-4eed-8d88-2325e0055742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:21.483481 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd81afd-9043-4eed-8d88-2325e0055742 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:21.483771 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd81afd-9043-4eed-8d88-2325e0055742 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:21.484052 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd81afd-9043-4eed-8d88-2325e0055742 None admin] PATH_INFO: `/v3/roles` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:21.484791 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd81afd-9043-4eed-8d88-2325e0055742 None admin] RBAC: Adding query filter params (name=service) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:28:21.485104 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd81afd-9043-4eed-8d88-2325e0055742 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:21.486566 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd81afd-9043-4eed-8d88-2325e0055742 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:21.496346 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 427/857] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jul 26 15:28:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:28:21.502213 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0b6131-d5d2-4946-929a-e9312240321b None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:21.591422 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:21.607211 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0b6131-d5d2-4946-929a-e9312240321b None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:21.642984 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a3880f-4575-4443-8123-7651bc386af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:21.643693 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a3880f-4575-4443-8123-7651bc386af5 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:21.643974 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a3880f-4575-4443-8123-7651bc386af5 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:21.644248 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a3880f-4575-4443-8123-7651bc386af5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:21.656658 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a3880f-4575-4443-8123-7651bc386af5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:21.658128 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a3880f-4575-4443-8123-7651bc386af5 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:21.673396 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application [None req-c3a3880f-4575-4443-8123-7651bc386af5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:28:21.673396 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:28:21.673396 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:28:21.673396 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:28:21.673396 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:28:21.673396 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:28:21.673396 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:28:21.673396 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:28:21.673396 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:28:21.673396 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:28:21.673396 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:28:21.673396 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:28:21.673396 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:28:21.673396 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:28:21.673396 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:28:21.674522 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:28:21.674522 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:28:21.674522 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:28:21.674522 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:28:21.674522 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:28:21.674522 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:28:21.674522 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:28:21.674522 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:28:21.674522 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application with Lock( Jul 26 15:28:21.674522 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:28:21.674522 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:28:21.674522 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:28:21.674522 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:28:21.674522 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:28:21.674522 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:28:21.674522 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:28:21.674522 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:28:21.675662 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:28:21.675662 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:28:21.675662 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:28:21.675662 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:28:21.675662 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 431/858] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 15:28:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:28:21.681194 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd81afd-9043-4eed-8d88-2325e0055742 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:21.785130 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd81afd-9043-4eed-8d88-2325e0055742 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:21.787443 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:21.819564 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbd9ffd-6a10-428b-8c30-116130dcdde9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:21.820189 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd9ffd-6a10-428b-8c30-116130dcdde9 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:21.820475 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd9ffd-6a10-428b-8c30-116130dcdde9 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:21.820754 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd9ffd-6a10-428b-8c30-116130dcdde9 None admin] PATH_INFO: `/v3/domains` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:21.821480 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbd9ffd-6a10-428b-8c30-116130dcdde9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:28:21.821793 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbd9ffd-6a10-428b-8c30-116130dcdde9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:21.823293 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbd9ffd-6a10-428b-8c30-116130dcdde9 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:21.836006 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 428/859] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 15:28:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:28:21.841853 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a3880f-4575-4443-8123-7651bc386af5 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:21.944650 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a3880f-4575-4443-8123-7651bc386af5 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:21.979292 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b29372-a5cc-4c37-a165-af451d820d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:21.979931 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b29372-a5cc-4c37-a165-af451d820d6d None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:21.980215 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b29372-a5cc-4c37-a165-af451d820d6d None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:21.980492 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b29372-a5cc-4c37-a165-af451d820d6d None admin] PATH_INFO: `/v3/users/placement` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:21.983364 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:21.989320 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b29372-a5cc-4c37-a165-af451d820d6d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:21.990810 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b29372-a5cc-4c37-a165-af451d820d6d None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:22.002130 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application [None req-b3b29372-a5cc-4c37-a165-af451d820d6d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 26 15:28:22.002130 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:28:22.002130 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:28:22.002130 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:28:22.002130 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:28:22.002130 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:28:22.002130 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:28:22.002130 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:28:22.002130 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:28:22.002130 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:28:22.002130 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:28:22.002130 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:28:22.002130 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 15:28:22.002130 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 15:28:22.002130 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 15:28:22.002130 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 15:28:22.003295 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:28:22.003295 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:28:22.003295 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 15:28:22.003295 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:28:22.003295 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 15:28:22.003295 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:28:22.003295 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:28:22.003295 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:28:22.003295 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:28:22.003295 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:28:22.003295 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:28:22.003295 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application with Lock( Jul 26 15:28:22.003295 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:28:22.003295 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:28:22.003295 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:28:22.003295 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:28:22.003295 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:28:22.003295 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:28:22.004448 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:28:22.004448 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:28:22.004448 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 15:28:22.004448 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 15:28:22.004448 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 15:28:22.004448 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 15:28:22.004448 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 15:28:22.004448 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 15:28:22.004448 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 26 15:28:22.004448 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:28:22.004448 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 432/860] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 15:28:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:28:22.009537 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbd9ffd-6a10-428b-8c30-116130dcdde9 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:22.111969 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbd9ffd-6a10-428b-8c30-116130dcdde9 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:22.150033 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3559f34-f3ac-4ae7-b276-28fd3e68a42a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:22.150684 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3559f34-f3ac-4ae7-b276-28fd3e68a42a None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:22.150966 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3559f34-f3ac-4ae7-b276-28fd3e68a42a None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:22.151276 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3559f34-f3ac-4ae7-b276-28fd3e68a42a None admin] PATH_INFO: `/v3/users` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:22.152108 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3559f34-f3ac-4ae7-b276-28fd3e68a42a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:28:22.152418 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3559f34-f3ac-4ae7-b276-28fd3e68a42a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:22.153920 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3559f34-f3ac-4ae7-b276-28fd3e68a42a None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:22.174520 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 429/861] 10.222.0.18 () {56 vars in 1143 bytes} [Tue Jul 26 15:28:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:28:22.181173 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b29372-a5cc-4c37-a165-af451d820d6d None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:22.283431 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b29372-a5cc-4c37-a165-af451d820d6d None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:22.317658 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1673e2d5-51f9-4abe-aa07-bd2bb0c92b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:22.318290 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1673e2d5-51f9-4abe-aa07-bd2bb0c92b3a None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:22.318573 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1673e2d5-51f9-4abe-aa07-bd2bb0c92b3a None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:22.318849 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1673e2d5-51f9-4abe-aa07-bd2bb0c92b3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:22.382126 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:22.388578 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1673e2d5-51f9-4abe-aa07-bd2bb0c92b3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:22.390107 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1673e2d5-51f9-4abe-aa07-bd2bb0c92b3a None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:22.488990 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 433/862] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 15:28:22 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 15:28:22.494915 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3559f34-f3ac-4ae7-b276-28fd3e68a42a None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:22.520948 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:22.598744 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3559f34-f3ac-4ae7-b276-28fd3e68a42a None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:22.633342 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87b66ba-7fda-4d0a-a56b-8b308652271a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:22.633909 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87b66ba-7fda-4d0a-a56b-8b308652271a None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:22.634191 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87b66ba-7fda-4d0a-a56b-8b308652271a None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:22.634470 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87b66ba-7fda-4d0a-a56b-8b308652271a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:22.644451 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87b66ba-7fda-4d0a-a56b-8b308652271a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:22.645928 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87b66ba-7fda-4d0a-a56b-8b308652271a None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:22.661944 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-f87b66ba-7fda-4d0a-a56b-8b308652271a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:28:22.661944 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:28:22.661944 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:28:22.661944 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:28:22.661944 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:28:22.661944 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:28:22.661944 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:28:22.661944 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:28:22.661944 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:28:22.661944 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:28:22.661944 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:28:22.661944 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:28:22.661944 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:28:22.661944 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:28:22.661944 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:28:22.663012 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:28:22.663012 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:28:22.663012 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:28:22.663012 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:28:22.663012 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:28:22.663012 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:28:22.663012 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:28:22.663012 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:28:22.663012 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:28:22.663012 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:28:22.663012 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:28:22.663012 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:28:22.663012 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:28:22.663012 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:28:22.663012 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:28:22.663012 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:28:22.663012 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:28:22.664356 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:28:22.664356 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:28:22.664356 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:28:22.664356 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:28:22.664356 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 430/863] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 15:28:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:28:22.669746 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1673e2d5-51f9-4abe-aa07-bd2bb0c92b3a None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:22.764182 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:22.770817 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1673e2d5-51f9-4abe-aa07-bd2bb0c92b3a None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:22.805603 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ccb29c-a904-4db8-902b-797cb8b52392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:22.806305 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ccb29c-a904-4db8-902b-797cb8b52392 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:22.806584 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ccb29c-a904-4db8-902b-797cb8b52392 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:22.806862 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ccb29c-a904-4db8-902b-797cb8b52392 None admin] PATH_INFO: `/v3/domains` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:22.807588 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ccb29c-a904-4db8-902b-797cb8b52392 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:28:22.807900 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ccb29c-a904-4db8-902b-797cb8b52392 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:22.809285 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ccb29c-a904-4db8-902b-797cb8b52392 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:22.821602 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 434/864] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 15:28:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:28:22.827409 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87b66ba-7fda-4d0a-a56b-8b308652271a None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:22.910946 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:22.935638 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87b66ba-7fda-4d0a-a56b-8b308652271a None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:22.970103 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2a06aa-c3a8-4e63-9979-bf9bdf52b8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:22.970735 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a06aa-c3a8-4e63-9979-bf9bdf52b8bf None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:22.971019 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a06aa-c3a8-4e63-9979-bf9bdf52b8bf None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:22.971329 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a06aa-c3a8-4e63-9979-bf9bdf52b8bf None admin] PATH_INFO: `/v3/projects/service` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:22.978466 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2a06aa-c3a8-4e63-9979-bf9bdf52b8bf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:22.979976 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2a06aa-c3a8-4e63-9979-bf9bdf52b8bf None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:22.991962 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-dc2a06aa-c3a8-4e63-9979-bf9bdf52b8bf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:28:22.991962 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:28:22.991962 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:28:22.991962 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:28:22.991962 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:28:22.991962 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:28:22.991962 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:28:22.991962 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:28:22.991962 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:28:22.991962 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:28:22.991962 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:28:22.991962 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:28:22.991962 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 15:28:22.991962 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 15:28:22.991962 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 15:28:22.992882 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 15:28:22.992882 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:28:22.992882 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:28:22.992882 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:28:22.992882 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:28:22.992882 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:28:22.992882 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:28:22.992882 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:28:22.992882 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:28:22.992882 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:28:22.992882 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:28:22.992882 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:28:22.992882 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:28:22.992882 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:28:22.992882 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:28:22.992882 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:28:22.992882 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:28:22.997851 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 15:28:22.997851 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 15:28:22.997851 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 15:28:22.997851 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 15:28:22.997851 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 15:28:22.997851 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 15:28:22.997851 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:28:22.997851 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:28:22.997851 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 431/865] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 15:28:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:28:22.999021 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ccb29c-a904-4db8-902b-797cb8b52392 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:23.100721 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ccb29c-a904-4db8-902b-797cb8b52392 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:23.134715 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac59de22-6c53-4a95-af68-8b98881c2da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:23.135364 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac59de22-6c53-4a95-af68-8b98881c2da2 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:23.135650 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac59de22-6c53-4a95-af68-8b98881c2da2 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:23.135925 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac59de22-6c53-4a95-af68-8b98881c2da2 None admin] PATH_INFO: `/v3/projects` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:23.136670 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac59de22-6c53-4a95-af68-8b98881c2da2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:28:23.136980 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac59de22-6c53-4a95-af68-8b98881c2da2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:23.138439 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac59de22-6c53-4a95-af68-8b98881c2da2 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:23.150477 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 435/866] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jul 26 15:28:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:28:23.156740 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2a06aa-c3a8-4e63-9979-bf9bdf52b8bf None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:23.260444 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2a06aa-c3a8-4e63-9979-bf9bdf52b8bf None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:23.297763 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0759d97b-d0d0-49c3-bd3d-3dca6086d670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:23.298389 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0759d97b-d0d0-49c3-bd3d-3dca6086d670 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:23.298672 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0759d97b-d0d0-49c3-bd3d-3dca6086d670 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:23.298954 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0759d97b-d0d0-49c3-bd3d-3dca6086d670 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:23.299780 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0759d97b-d0d0-49c3-bd3d-3dca6086d670 None admin] RBAC: Adding query filter params (role.id=2a6f012a2a004fbb8ab4d8a5f8633a22, scope.project.id=9178e468facc41d6a7d828dfcd5301b4, user.id=21a7f59ebf1b40a1b76ee2002ae38230) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:28:23.300093 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0759d97b-d0d0-49c3-bd3d-3dca6086d670 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:23.302106 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0759d97b-d0d0-49c3-bd3d-3dca6086d670 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:23.304280 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:23.309226 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 432/867] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 26 15:28:23 2022] GET /identity/v3/role_assignments?user.id=21a7f59ebf1b40a1b76ee2002ae38230&scope.project.id=9178e468facc41d6a7d828dfcd5301b4&role.id=2a6f012a2a004fbb8ab4d8a5f8633a22 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:28:25.656053 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877cedcf-7d0c-4fed-9eea-72cc7e1784ab None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:25.656588 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877cedcf-7d0c-4fed-9eea-72cc7e1784ab None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:25.656588 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877cedcf-7d0c-4fed-9eea-72cc7e1784ab None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:25.658100 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 436/868] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:28:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:28:25.663931 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d564fd9-0db9-47fc-b181-8ed8d680400b None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:25.664384 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d564fd9-0db9-47fc-b181-8ed8d680400b None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:25.664482 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d564fd9-0db9-47fc-b181-8ed8d680400b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:25.684135 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-6d564fd9-0db9-47fc-b181-8ed8d680400b None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:28:25.685399 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-6d564fd9-0db9-47fc-b181-8ed8d680400b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:28:25.759518 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 433/869] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:28:25 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 15:28:25.784826 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877cedcf-7d0c-4fed-9eea-72cc7e1784ab None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:25.803248 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:25.888926 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877cedcf-7d0c-4fed-9eea-72cc7e1784ab None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:25.923515 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea11de5e-5003-411a-8a06-361340938fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:25.924076 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea11de5e-5003-411a-8a06-361340938fa2 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:25.924355 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea11de5e-5003-411a-8a06-361340938fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:25.924628 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea11de5e-5003-411a-8a06-361340938fa2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:25.937100 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea11de5e-5003-411a-8a06-361340938fa2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:28:25.941707 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application [None req-ea11de5e-5003-411a-8a06-361340938fa2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 15:28:25.941707 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:28:25.941707 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:28:25.941707 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:28:25.941707 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:28:25.941707 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:28:25.941707 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:28:25.941707 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:28:25.941707 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:28:25.941707 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:28:25.941707 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:28:25.941707 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:28:25.941707 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:28:25.941707 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:28:25.941707 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:28:25.941707 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:28:25.943009 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:28:25.943009 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:28:25.943009 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:28:25.943009 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:28:25.943009 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:28:25.943009 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:28:25.943009 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:28:25.943009 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:28:25.943009 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:28:25.943009 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:28:25.943009 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:28:25.943009 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application with Lock( Jul 26 15:28:25.943009 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:28:25.943009 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:28:25.943009 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:28:25.943009 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:28:25.944234 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:28:25.944234 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:28:25.944234 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:28:25.944234 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:28:25.944234 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:28:25.944234 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:28:25.944234 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:28:25.944234 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:28:25.944234 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:28:25.944234 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:28:25.944234 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 15:28:25.944234 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:28:25.944234 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 437/870] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jul 26 15:28:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:28:25.948998 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d564fd9-0db9-47fc-b181-8ed8d680400b None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:26.049185 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d564fd9-0db9-47fc-b181-8ed8d680400b None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:26.076749 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:26.084783 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d010a-680d-4059-a7b1-b1a0fcfddb06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:26.085412 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d010a-680d-4059-a7b1-b1a0fcfddb06 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:26.085701 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d010a-680d-4059-a7b1-b1a0fcfddb06 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:26.085986 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d010a-680d-4059-a7b1-b1a0fcfddb06 None admin] PATH_INFO: `/v3/roles` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:26.086751 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525d010a-680d-4059-a7b1-b1a0fcfddb06 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:28:26.087061 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525d010a-680d-4059-a7b1-b1a0fcfddb06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:26.092049 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525d010a-680d-4059-a7b1-b1a0fcfddb06 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:26.096680 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 434/871] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 15:28:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:28:26.102610 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea11de5e-5003-411a-8a06-361340938fa2 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:26.180951 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:26.204380 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea11de5e-5003-411a-8a06-361340938fa2 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:26.237301 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23227ca1-df3b-4443-b74a-fc206842804d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:26.237939 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23227ca1-df3b-4443-b74a-fc206842804d None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:26.238723 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23227ca1-df3b-4443-b74a-fc206842804d None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:26.238998 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23227ca1-df3b-4443-b74a-fc206842804d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:26.249686 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23227ca1-df3b-4443-b74a-fc206842804d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:26.251206 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23227ca1-df3b-4443-b74a-fc206842804d None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:26.265859 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application [None req-23227ca1-df3b-4443-b74a-fc206842804d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:28:26.265859 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:28:26.265859 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:28:26.265859 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:28:26.265859 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:28:26.265859 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:28:26.265859 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:28:26.265859 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:28:26.265859 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:28:26.265859 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:28:26.265859 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:28:26.265859 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:28:26.265859 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:28:26.265859 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:28:26.265859 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:28:26.271041 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:28:26.271041 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:28:26.271041 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:28:26.271041 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:28:26.271041 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:28:26.271041 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:28:26.271041 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:28:26.271041 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:28:26.271041 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application with Lock( Jul 26 15:28:26.271041 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:28:26.271041 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:28:26.271041 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:28:26.271041 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:28:26.271041 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:28:26.271041 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:28:26.271041 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:28:26.271041 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:28:26.272108 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:28:26.272108 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:28:26.272108 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:28:26.272108 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:28:26.272108 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 438/872] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 15:28:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:28:26.273117 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d010a-680d-4059-a7b1-b1a0fcfddb06 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:26.375712 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d010a-680d-4059-a7b1-b1a0fcfddb06 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:26.412279 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e3725-f05c-4f49-bfd8-9f961801d95c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:26.412917 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e3725-f05c-4f49-bfd8-9f961801d95c None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:26.413199 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e3725-f05c-4f49-bfd8-9f961801d95c None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:26.413476 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e3725-f05c-4f49-bfd8-9f961801d95c None admin] PATH_INFO: `/v3/domains` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:26.414180 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3e3725-f05c-4f49-bfd8-9f961801d95c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:28:26.414486 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3e3725-f05c-4f49-bfd8-9f961801d95c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:26.416001 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3e3725-f05c-4f49-bfd8-9f961801d95c None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:26.431090 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 435/873] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 15:28:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:28:26.437270 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23227ca1-df3b-4443-b74a-fc206842804d None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:26.545042 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23227ca1-df3b-4443-b74a-fc206842804d None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:26.573906 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:26.581718 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2484db-f708-4b10-a0ff-ff6b4a498c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:26.582392 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2484db-f708-4b10-a0ff-ff6b4a498c5d None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:26.582674 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2484db-f708-4b10-a0ff-ff6b4a498c5d None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:26.582945 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2484db-f708-4b10-a0ff-ff6b4a498c5d None admin] PATH_INFO: `/v3/users/placement` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:26.591064 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2484db-f708-4b10-a0ff-ff6b4a498c5d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:26.592760 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2484db-f708-4b10-a0ff-ff6b4a498c5d None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:26.605377 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application [None req-ba2484db-f708-4b10-a0ff-ff6b4a498c5d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 26 15:28:26.605377 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:28:26.605377 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:28:26.605377 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:28:26.605377 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:28:26.605377 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:28:26.605377 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:28:26.605377 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:28:26.605377 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:28:26.605377 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:28:26.605377 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:28:26.605377 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:28:26.605377 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 15:28:26.605377 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 15:28:26.605377 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 15:28:26.605377 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 15:28:26.606682 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:28:26.606682 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:28:26.606682 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 15:28:26.606682 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:28:26.606682 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 15:28:26.606682 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:28:26.606682 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:28:26.606682 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:28:26.606682 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:28:26.606682 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:28:26.606682 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:28:26.606682 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application with Lock( Jul 26 15:28:26.606682 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:28:26.606682 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:28:26.606682 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:28:26.606682 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:28:26.606682 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:28:26.606682 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:28:26.607712 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:28:26.607712 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:28:26.607712 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 15:28:26.607712 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 15:28:26.607712 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 15:28:26.607712 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 15:28:26.607712 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 15:28:26.607712 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 15:28:26.607712 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 26 15:28:26.607712 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:28:26.607712 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 439/874] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 15:28:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:28:26.613655 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e3725-f05c-4f49-bfd8-9f961801d95c None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:26.667725 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:26.718028 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e3725-f05c-4f49-bfd8-9f961801d95c None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:26.753281 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de820271-baba-422a-b54b-0392baa1a9a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:26.753940 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de820271-baba-422a-b54b-0392baa1a9a4 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:26.754226 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de820271-baba-422a-b54b-0392baa1a9a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:26.754509 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de820271-baba-422a-b54b-0392baa1a9a4 None admin] PATH_INFO: `/v3/users` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:26.755341 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de820271-baba-422a-b54b-0392baa1a9a4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:28:26.755659 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de820271-baba-422a-b54b-0392baa1a9a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:26.757115 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de820271-baba-422a-b54b-0392baa1a9a4 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:26.774795 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 436/875] 10.222.0.18 () {56 vars in 1143 bytes} [Tue Jul 26 15:28:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:28:26.780886 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2484db-f708-4b10-a0ff-ff6b4a498c5d None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:26.883409 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2484db-f708-4b10-a0ff-ff6b4a498c5d None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:26.918568 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee98a08b-9b6b-47bf-8105-6d957c3d2c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:26.919261 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98a08b-9b6b-47bf-8105-6d957c3d2c81 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:26.919549 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98a08b-9b6b-47bf-8105-6d957c3d2c81 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:26.919829 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98a08b-9b6b-47bf-8105-6d957c3d2c81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:26.979823 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:26.994236 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee98a08b-9b6b-47bf-8105-6d957c3d2c81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:26.995750 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee98a08b-9b6b-47bf-8105-6d957c3d2c81 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:27.101857 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 440/876] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 15:28:26 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 26 15:28:27.107895 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de820271-baba-422a-b54b-0392baa1a9a4 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:27.215528 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de820271-baba-422a-b54b-0392baa1a9a4 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:27.225263 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:27.250110 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacb4826-696d-4156-834e-ff8a86e2c820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:27.250684 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb4826-696d-4156-834e-ff8a86e2c820 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:27.250966 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb4826-696d-4156-834e-ff8a86e2c820 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:27.251296 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb4826-696d-4156-834e-ff8a86e2c820 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:27.262576 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacb4826-696d-4156-834e-ff8a86e2c820 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:27.269985 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacb4826-696d-4156-834e-ff8a86e2c820 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:27.279069 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-aacb4826-696d-4156-834e-ff8a86e2c820 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:28:27.279069 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:28:27.279069 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:28:27.279069 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:28:27.279069 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:28:27.279069 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:28:27.279069 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:28:27.279069 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:28:27.279069 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:28:27.279069 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:28:27.279069 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:28:27.279069 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:28:27.279069 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:28:27.279069 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:28:27.279069 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:28:27.280162 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:28:27.280162 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:28:27.280162 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:28:27.280162 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:28:27.280162 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:28:27.280162 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:28:27.280162 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:28:27.280162 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:28:27.280162 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:28:27.280162 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:28:27.280162 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:28:27.280162 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:28:27.280162 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:28:27.280162 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:28:27.280162 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:28:27.280162 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:28:27.280162 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:28:27.286058 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:28:27.286058 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:28:27.286058 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:28:27.286058 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:28:27.286058 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 437/877] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 15:28:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:28:27.286415 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee98a08b-9b6b-47bf-8105-6d957c3d2c81 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:27.383267 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:27.395593 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee98a08b-9b6b-47bf-8105-6d957c3d2c81 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:27.429803 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bfd6d9-0ecd-4e5c-9438-96cb93a64879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:27.430495 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bfd6d9-0ecd-4e5c-9438-96cb93a64879 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:27.430783 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bfd6d9-0ecd-4e5c-9438-96cb93a64879 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:27.431063 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bfd6d9-0ecd-4e5c-9438-96cb93a64879 None admin] PATH_INFO: `/v3/domains` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:27.431789 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bfd6d9-0ecd-4e5c-9438-96cb93a64879 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:28:27.432100 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bfd6d9-0ecd-4e5c-9438-96cb93a64879 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:27.433478 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bfd6d9-0ecd-4e5c-9438-96cb93a64879 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:27.445996 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 441/878] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 15:28:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:28:27.452018 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacb4826-696d-4156-834e-ff8a86e2c820 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:27.558224 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacb4826-696d-4156-834e-ff8a86e2c820 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:27.593739 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028a92a4-f1c9-4c86-88bd-10680a550d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:27.594413 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a92a4-f1c9-4c86-88bd-10680a550d7d None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:27.594701 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a92a4-f1c9-4c86-88bd-10680a550d7d None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:27.594980 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a92a4-f1c9-4c86-88bd-10680a550d7d None admin] PATH_INFO: `/v3/projects/service` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:27.602408 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028a92a4-f1c9-4c86-88bd-10680a550d7d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:27.603924 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028a92a4-f1c9-4c86-88bd-10680a550d7d None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:27.615216 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-028a92a4-f1c9-4c86-88bd-10680a550d7d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:28:27.615216 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:28:27.615216 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:28:27.615216 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:28:27.615216 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:28:27.615216 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:28:27.615216 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:28:27.615216 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:28:27.615216 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:28:27.615216 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:28:27.615216 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:28:27.615216 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:28:27.615216 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 15:28:27.615216 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 15:28:27.615216 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 15:28:27.616259 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 15:28:27.616259 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:28:27.616259 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:28:27.616259 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:28:27.616259 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:28:27.616259 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:28:27.616259 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:28:27.616259 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:28:27.616259 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:28:27.616259 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:28:27.616259 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:28:27.616259 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:28:27.616259 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:28:27.616259 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:28:27.616259 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:28:27.616259 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:28:27.616259 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:28:27.617158 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 15:28:27.617158 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 15:28:27.617158 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 15:28:27.617158 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 15:28:27.617158 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 15:28:27.617158 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 15:28:27.617158 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:28:27.617158 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:28:27.617158 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 438/879] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 15:28:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:28:27.625520 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bfd6d9-0ecd-4e5c-9438-96cb93a64879 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:27.730482 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bfd6d9-0ecd-4e5c-9438-96cb93a64879 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:27.765383 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4ead44-8868-4089-848c-22fd12a10a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:27.766009 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ead44-8868-4089-848c-22fd12a10a13 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:27.766297 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ead44-8868-4089-848c-22fd12a10a13 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:27.766572 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ead44-8868-4089-848c-22fd12a10a13 None admin] PATH_INFO: `/v3/projects` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:27.767356 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4ead44-8868-4089-848c-22fd12a10a13 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:28:27.767666 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4ead44-8868-4089-848c-22fd12a10a13 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:27.769138 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4ead44-8868-4089-848c-22fd12a10a13 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:27.782580 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 442/880] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jul 26 15:28:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:28:27.789518 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028a92a4-f1c9-4c86-88bd-10680a550d7d None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:27.813013 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:27.891364 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028a92a4-f1c9-4c86-88bd-10680a550d7d None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:27.936449 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc5ad7f-179c-4d81-8219-50bad6689268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:27.937078 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5ad7f-179c-4d81-8219-50bad6689268 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:27.937404 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5ad7f-179c-4d81-8219-50bad6689268 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:27.937695 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5ad7f-179c-4d81-8219-50bad6689268 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:27.938492 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc5ad7f-179c-4d81-8219-50bad6689268 None admin] RBAC: Adding query filter params (role.id=2c659645e15c4204b1457556939397cb, scope.project.id=9178e468facc41d6a7d828dfcd5301b4, user.id=21a7f59ebf1b40a1b76ee2002ae38230) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:28:27.938851 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc5ad7f-179c-4d81-8219-50bad6689268 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:27.940538 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc5ad7f-179c-4d81-8219-50bad6689268 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:27.954749 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 439/881] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 26 15:28:27 2022] GET /identity/v3/role_assignments?user.id=21a7f59ebf1b40a1b76ee2002ae38230&scope.project.id=9178e468facc41d6a7d828dfcd5301b4&role.id=2c659645e15c4204b1457556939397cb => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:28:30.237252 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2e009-ccc5-425b-be26-a36ef47b6be6 None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:30.243055 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2e009-ccc5-425b-be26-a36ef47b6be6 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:30.243055 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2e009-ccc5-425b-be26-a36ef47b6be6 None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:30.243055 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 443/882] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:28:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:28:30.244648 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb45a9-7564-4f04-ad49-0f80c6a115ee None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:30.245049 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb45a9-7564-4f04-ad49-0f80c6a115ee None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:30.245215 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb45a9-7564-4f04-ad49-0f80c6a115ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:30.264773 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-83eb45a9-7564-4f04-ad49-0f80c6a115ee None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:28:30.265993 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-83eb45a9-7564-4f04-ad49-0f80c6a115ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:28:30.333833 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 440/883] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:28:30 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 15:28:30.358112 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a2e009-ccc5-425b-be26-a36ef47b6be6 None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:30.370016 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:30.461746 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a2e009-ccc5-425b-be26-a36ef47b6be6 None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:30.502757 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61359fdf-8f27-42ef-912b-9ac988edefa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:30.503364 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61359fdf-8f27-42ef-912b-9ac988edefa4 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:30.503649 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61359fdf-8f27-42ef-912b-9ac988edefa4 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:30.503928 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61359fdf-8f27-42ef-912b-9ac988edefa4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:30.514229 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61359fdf-8f27-42ef-912b-9ac988edefa4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:28:30.519699 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application [None req-61359fdf-8f27-42ef-912b-9ac988edefa4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 15:28:30.519699 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:28:30.519699 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:28:30.519699 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:28:30.519699 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:28:30.519699 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:28:30.519699 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:28:30.519699 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:28:30.519699 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:28:30.519699 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:28:30.519699 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:28:30.519699 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:28:30.519699 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:28:30.519699 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:28:30.519699 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:28:30.519699 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:28:30.520830 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:28:30.520830 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:28:30.520830 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:28:30.520830 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:28:30.520830 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:28:30.520830 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:28:30.520830 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:28:30.520830 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:28:30.520830 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:28:30.520830 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:28:30.520830 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:28:30.520830 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application with Lock( Jul 26 15:28:30.520830 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:28:30.520830 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:28:30.520830 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:28:30.520830 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:28:30.521924 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:28:30.521924 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:28:30.521924 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:28:30.521924 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:28:30.521924 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:28:30.521924 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:28:30.521924 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:28:30.521924 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:28:30.521924 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:28:30.521924 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:28:30.521924 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 15:28:30.521924 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:28:30.521924 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 444/884] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jul 26 15:28:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:28:30.526937 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eb45a9-7564-4f04-ad49-0f80c6a115ee None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:30.543208 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:30.624483 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eb45a9-7564-4f04-ad49-0f80c6a115ee None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:30.662137 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fcd760-59e5-4b7b-8112-5432da6a4776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:30.662789 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fcd760-59e5-4b7b-8112-5432da6a4776 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:30.663049 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fcd760-59e5-4b7b-8112-5432da6a4776 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:30.663364 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fcd760-59e5-4b7b-8112-5432da6a4776 None admin] PATH_INFO: `/v3/roles` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:30.664102 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fcd760-59e5-4b7b-8112-5432da6a4776 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:28:30.664409 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fcd760-59e5-4b7b-8112-5432da6a4776 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:30.665815 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fcd760-59e5-4b7b-8112-5432da6a4776 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:30.674539 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 441/885] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 15:28:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:28:30.680613 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61359fdf-8f27-42ef-912b-9ac988edefa4 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:30.749684 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:30.782842 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61359fdf-8f27-42ef-912b-9ac988edefa4 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:30.818155 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a032791b-f6da-4f65-a1dd-b8b68c300c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:30.818800 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a032791b-f6da-4f65-a1dd-b8b68c300c00 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:30.819087 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a032791b-f6da-4f65-a1dd-b8b68c300c00 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:30.819401 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a032791b-f6da-4f65-a1dd-b8b68c300c00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:30.829282 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a032791b-f6da-4f65-a1dd-b8b68c300c00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:30.830729 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a032791b-f6da-4f65-a1dd-b8b68c300c00 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:30.846018 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application [None req-a032791b-f6da-4f65-a1dd-b8b68c300c00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:28:30.846018 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:28:30.846018 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:28:30.846018 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:28:30.846018 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:28:30.846018 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:28:30.846018 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:28:30.846018 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:28:30.846018 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:28:30.846018 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:28:30.846018 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:28:30.846018 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:28:30.846018 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:28:30.846018 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:28:30.846018 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:28:30.847074 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:28:30.847074 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:28:30.847074 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:28:30.847074 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:28:30.847074 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:28:30.847074 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:28:30.847074 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:28:30.847074 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:28:30.847074 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application with Lock( Jul 26 15:28:30.847074 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:28:30.847074 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:28:30.847074 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:28:30.847074 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:28:30.847074 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:28:30.847074 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:28:30.847074 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:28:30.847074 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:28:30.848003 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:28:30.848003 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:28:30.848003 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:28:30.848003 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:28:30.848003 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 445/886] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 15:28:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:28:30.853177 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fcd760-59e5-4b7b-8112-5432da6a4776 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:30.935337 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:30.958666 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fcd760-59e5-4b7b-8112-5432da6a4776 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:30.991491 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86bb750-c19e-427b-84a5-dc6b2ce5cd44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:30.992116 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86bb750-c19e-427b-84a5-dc6b2ce5cd44 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:30.992399 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86bb750-c19e-427b-84a5-dc6b2ce5cd44 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:30.992674 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86bb750-c19e-427b-84a5-dc6b2ce5cd44 None admin] PATH_INFO: `/v3/domains` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:30.993365 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86bb750-c19e-427b-84a5-dc6b2ce5cd44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:28:30.993669 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86bb750-c19e-427b-84a5-dc6b2ce5cd44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:30.995053 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86bb750-c19e-427b-84a5-dc6b2ce5cd44 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:31.007759 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 442/887] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 15:28:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:28:31.013588 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a032791b-f6da-4f65-a1dd-b8b68c300c00 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:31.115232 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a032791b-f6da-4f65-a1dd-b8b68c300c00 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:31.135475 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:31.150877 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407f7734-dc11-45d3-9403-98cecee91c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:31.151548 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f7734-dc11-45d3-9403-98cecee91c80 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:31.151923 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f7734-dc11-45d3-9403-98cecee91c80 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:31.152155 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f7734-dc11-45d3-9403-98cecee91c80 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:31.160379 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407f7734-dc11-45d3-9403-98cecee91c80 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:31.161838 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407f7734-dc11-45d3-9403-98cecee91c80 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:31.173322 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application [None req-407f7734-dc11-45d3-9403-98cecee91c80 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 26 15:28:31.173322 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:28:31.173322 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:28:31.173322 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:28:31.173322 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:28:31.173322 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:28:31.173322 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:28:31.173322 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:28:31.173322 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:28:31.173322 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:28:31.173322 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:28:31.173322 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:28:31.173322 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 15:28:31.173322 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 15:28:31.173322 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 15:28:31.173322 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 15:28:31.174498 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:28:31.174498 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:28:31.174498 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 15:28:31.174498 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:28:31.174498 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 15:28:31.174498 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:28:31.174498 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:28:31.174498 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:28:31.174498 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:28:31.174498 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:28:31.174498 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:28:31.174498 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application with Lock( Jul 26 15:28:31.174498 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:28:31.174498 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:28:31.174498 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:28:31.174498 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:28:31.174498 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:28:31.174498 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:28:31.176115 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:28:31.176115 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:28:31.176115 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 15:28:31.176115 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 15:28:31.176115 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 15:28:31.176115 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 15:28:31.176115 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 15:28:31.176115 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 15:28:31.176115 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 26 15:28:31.176115 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:28:31.176115 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 446/888] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 15:28:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:28:31.182532 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86bb750-c19e-427b-84a5-dc6b2ce5cd44 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:31.286296 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86bb750-c19e-427b-84a5-dc6b2ce5cd44 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:31.320402 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f57f59-7402-4843-b291-12bd1a1a37c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:31.321025 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f57f59-7402-4843-b291-12bd1a1a37c8 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:31.321308 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f57f59-7402-4843-b291-12bd1a1a37c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:31.321579 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f57f59-7402-4843-b291-12bd1a1a37c8 None admin] PATH_INFO: `/v3/users` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:31.322384 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f57f59-7402-4843-b291-12bd1a1a37c8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:28:31.322694 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f57f59-7402-4843-b291-12bd1a1a37c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:31.324191 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f57f59-7402-4843-b291-12bd1a1a37c8 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:31.326956 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:31.343102 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 443/889] 10.222.0.18 () {56 vars in 1143 bytes} [Tue Jul 26 15:28:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:28:31.348980 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407f7734-dc11-45d3-9403-98cecee91c80 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:31.455453 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407f7734-dc11-45d3-9403-98cecee91c80 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:31.489280 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a932a5-5fe4-4725-8120-e26cb6dc59b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:31.489921 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a932a5-5fe4-4725-8120-e26cb6dc59b0 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:31.490205 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a932a5-5fe4-4725-8120-e26cb6dc59b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:31.490484 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a932a5-5fe4-4725-8120-e26cb6dc59b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:31.501076 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a932a5-5fe4-4725-8120-e26cb6dc59b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:31.502636 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a932a5-5fe4-4725-8120-e26cb6dc59b0 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:31.521657 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application [None req-11a932a5-5fe4-4725-8120-e26cb6dc59b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:28:31.521657 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:28:31.521657 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:28:31.521657 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:28:31.521657 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:28:31.521657 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:28:31.521657 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:28:31.521657 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:28:31.521657 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:28:31.521657 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:28:31.521657 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:28:31.521657 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:28:31.521657 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:28:31.521657 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:28:31.521657 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:28:31.527055 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:28:31.527055 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:28:31.527055 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:28:31.527055 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:28:31.527055 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:28:31.527055 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:28:31.527055 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:28:31.527055 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:28:31.527055 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application with Lock( Jul 26 15:28:31.527055 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:28:31.527055 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:28:31.527055 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:28:31.527055 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:28:31.527055 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:28:31.527055 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:28:31.527055 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:28:31.527055 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:28:31.528174 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:28:31.528174 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:28:31.528174 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:28:31.528174 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:28:31.528174 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 447/890] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 15:28:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:28:31.528820 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f57f59-7402-4843-b291-12bd1a1a37c8 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:31.628953 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f57f59-7402-4843-b291-12bd1a1a37c8 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:31.662675 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570d8574-a457-4d90-98af-7aad4b353415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:31.663326 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570d8574-a457-4d90-98af-7aad4b353415 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:31.663612 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570d8574-a457-4d90-98af-7aad4b353415 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:31.663894 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570d8574-a457-4d90-98af-7aad4b353415 None admin] PATH_INFO: `/v3/domains` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:31.664578 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570d8574-a457-4d90-98af-7aad4b353415 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:28:31.664882 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570d8574-a457-4d90-98af-7aad4b353415 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:31.666524 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570d8574-a457-4d90-98af-7aad4b353415 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:31.680544 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 444/891] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 15:28:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:28:31.686169 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a932a5-5fe4-4725-8120-e26cb6dc59b0 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:31.719079 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:31.787031 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a932a5-5fe4-4725-8120-e26cb6dc59b0 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:31.820020 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7661fd98-41ce-467d-8fba-2cad9f834b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:31.820657 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7661fd98-41ce-467d-8fba-2cad9f834b41 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:31.820944 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7661fd98-41ce-467d-8fba-2cad9f834b41 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:31.821224 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7661fd98-41ce-467d-8fba-2cad9f834b41 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:31.827869 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7661fd98-41ce-467d-8fba-2cad9f834b41 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:31.829330 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7661fd98-41ce-467d-8fba-2cad9f834b41 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:31.841895 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application [None req-7661fd98-41ce-467d-8fba-2cad9f834b41 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:28:31.841895 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:28:31.841895 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:28:31.841895 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:28:31.841895 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:28:31.841895 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:28:31.841895 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:28:31.841895 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:28:31.841895 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:28:31.841895 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:28:31.841895 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:28:31.841895 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:28:31.841895 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 15:28:31.841895 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 15:28:31.841895 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 15:28:31.842938 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 15:28:31.842938 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:28:31.842938 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:28:31.842938 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:28:31.842938 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:28:31.842938 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:28:31.842938 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:28:31.842938 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:28:31.842938 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application with Lock( Jul 26 15:28:31.842938 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:28:31.842938 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:28:31.842938 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:28:31.842938 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:28:31.842938 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:28:31.842938 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:28:31.842938 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:28:31.842938 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:28:31.844238 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 15:28:31.844238 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 15:28:31.844238 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 15:28:31.844238 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 15:28:31.844238 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 15:28:31.844238 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 15:28:31.844238 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:28:31.844238 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:28:31.844238 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 448/892] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 15:28:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:28:31.848904 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570d8574-a457-4d90-98af-7aad4b353415 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:31.905354 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:31.949972 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570d8574-a457-4d90-98af-7aad4b353415 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:31.987179 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7465cc-0c4c-4f79-ba2b-11d329807e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:31.988299 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7465cc-0c4c-4f79-ba2b-11d329807e5e None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:31.988592 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7465cc-0c4c-4f79-ba2b-11d329807e5e None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:31.988869 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7465cc-0c4c-4f79-ba2b-11d329807e5e None admin] PATH_INFO: `/v3/projects` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:31.989659 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7465cc-0c4c-4f79-ba2b-11d329807e5e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:28:31.989971 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7465cc-0c4c-4f79-ba2b-11d329807e5e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:31.991512 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7465cc-0c4c-4f79-ba2b-11d329807e5e None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:32.005940 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 445/893] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jul 26 15:28:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:28:32.012224 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7661fd98-41ce-467d-8fba-2cad9f834b41 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:32.107286 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:32.115994 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7661fd98-41ce-467d-8fba-2cad9f834b41 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:32.149551 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eccf57a-ce9f-4368-a25d-2b821982f0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:32.150237 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eccf57a-ce9f-4368-a25d-2b821982f0a8 None admin] REQUEST_METHOD: `PUT` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:32.150517 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eccf57a-ce9f-4368-a25d-2b821982f0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:32.150792 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eccf57a-ce9f-4368-a25d-2b821982f0a8 None admin] PATH_INFO: `/v3/projects/9178e468facc41d6a7d828dfcd5301b4/users/21a7f59ebf1b40a1b76ee2002ae38230/roles/2c659645e15c4204b1457556939397cb` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:32.152807 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eccf57a-ce9f-4368-a25d-2b821982f0a8 None admin] RBAC: Authorizing `identity:create_grant(project_id=9178e468facc41d6a7d828dfcd5301b4, user_id=21a7f59ebf1b40a1b76ee2002ae38230, role_id=2c659645e15c4204b1457556939397cb)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:32.154243 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eccf57a-ce9f-4368-a25d-2b821982f0a8 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:32.316628 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 449/894] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jul 26 15:28:32 2022] PUT /identity/v3/projects/9178e468facc41d6a7d828dfcd5301b4/users/21a7f59ebf1b40a1b76ee2002ae38230/roles/2c659645e15c4204b1457556939397cb => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:28:34.558126 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d6e64-3b56-470e-90a1-1dead46ac9e7 None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:34.558683 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d6e64-3b56-470e-90a1-1dead46ac9e7 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:34.558683 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d6e64-3b56-470e-90a1-1dead46ac9e7 None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:34.560113 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 446/895] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:28:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:28:34.566485 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd917dda-944a-4e76-8504-58acb98edf3a None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:34.567556 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd917dda-944a-4e76-8504-58acb98edf3a None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:34.568006 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd917dda-944a-4e76-8504-58acb98edf3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:34.587829 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-dd917dda-944a-4e76-8504-58acb98edf3a None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:28:34.589066 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-dd917dda-944a-4e76-8504-58acb98edf3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:28:34.664635 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 450/896] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:28:34 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 15:28:34.690186 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72d6e64-3b56-470e-90a1-1dead46ac9e7 None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:34.803257 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72d6e64-3b56-470e-90a1-1dead46ac9e7 None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:34.819058 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:34.840399 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a3fce4-de31-490a-a423-791ed29e6d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:34.841061 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a3fce4-de31-490a-a423-791ed29e6d26 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:34.841341 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a3fce4-de31-490a-a423-791ed29e6d26 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:34.841615 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a3fce4-de31-490a-a423-791ed29e6d26 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:34.853967 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a3fce4-de31-490a-a423-791ed29e6d26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:28:34.859150 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-c3a3fce4-de31-490a-a423-791ed29e6d26 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 15:28:34.859150 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:28:34.859150 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:28:34.859150 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:28:34.859150 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:28:34.859150 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:28:34.859150 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:28:34.859150 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:28:34.859150 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:28:34.859150 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:28:34.859150 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:28:34.859150 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:28:34.859150 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:28:34.859150 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:28:34.859150 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:28:34.859150 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:28:34.860282 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:28:34.860282 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:28:34.860282 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:28:34.860282 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:28:34.860282 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:28:34.860282 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:28:34.860282 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:28:34.860282 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:28:34.860282 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:28:34.860282 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:28:34.860282 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:28:34.860282 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:28:34.860282 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:28:34.860282 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:28:34.860282 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:28:34.860282 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:28:34.861149 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:28:34.861149 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:28:34.861149 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:28:34.861149 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:28:34.861149 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:28:34.861149 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:28:34.861149 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:28:34.861149 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:28:34.861149 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:28:34.861149 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:28:34.861149 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 15:28:34.861149 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:28:34.861149 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 447/897] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jul 26 15:28:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:28:34.866948 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd917dda-944a-4e76-8504-58acb98edf3a None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:34.966764 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:34.991587 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd917dda-944a-4e76-8504-58acb98edf3a None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:35.033120 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e862e7-26c6-44cd-a46c-bc716d64855d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:35.033803 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e862e7-26c6-44cd-a46c-bc716d64855d None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:35.034127 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e862e7-26c6-44cd-a46c-bc716d64855d None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:35.034497 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e862e7-26c6-44cd-a46c-bc716d64855d None admin] PATH_INFO: `/v3/roles` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:35.035354 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e862e7-26c6-44cd-a46c-bc716d64855d None admin] RBAC: Adding query filter params (name=admin) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:28:35.035758 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e862e7-26c6-44cd-a46c-bc716d64855d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:35.037188 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e862e7-26c6-44cd-a46c-bc716d64855d None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:35.046432 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 451/898] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 15:28:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:28:35.053056 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a3fce4-de31-490a-a423-791ed29e6d26 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:35.158714 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a3fce4-de31-490a-a423-791ed29e6d26 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:35.197927 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a6a2e1-b911-4ecd-a2ea-e671af0a2398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:35.198578 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a6a2e1-b911-4ecd-a2ea-e671af0a2398 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:35.199168 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a6a2e1-b911-4ecd-a2ea-e671af0a2398 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:35.199168 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a6a2e1-b911-4ecd-a2ea-e671af0a2398 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:35.209931 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a6a2e1-b911-4ecd-a2ea-e671af0a2398 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:35.211456 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a6a2e1-b911-4ecd-a2ea-e671af0a2398 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:35.227392 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-53a6a2e1-b911-4ecd-a2ea-e671af0a2398 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:28:35.227392 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:28:35.227392 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:28:35.227392 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:28:35.227392 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:28:35.227392 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:28:35.227392 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:28:35.227392 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:28:35.227392 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:28:35.227392 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:28:35.227392 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:28:35.227392 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:28:35.227392 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:28:35.227392 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:28:35.227392 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:28:35.229278 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:28:35.229278 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:28:35.229278 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:28:35.229278 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:28:35.229278 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:28:35.229278 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:28:35.229278 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:28:35.229278 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:28:35.229278 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:28:35.229278 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:28:35.229278 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:28:35.229278 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:28:35.229278 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:28:35.229278 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:28:35.229278 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:28:35.229278 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:28:35.229278 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:28:35.230927 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:28:35.230927 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:28:35.230927 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:28:35.230927 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:28:35.230927 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 448/899] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 15:28:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:28:35.235296 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e862e7-26c6-44cd-a46c-bc716d64855d None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:35.354844 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e862e7-26c6-44cd-a46c-bc716d64855d None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:35.389656 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4aaf41-e62a-4a4d-a9da-977a7f61ff9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:35.390284 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4aaf41-e62a-4a4d-a9da-977a7f61ff9c None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:35.390565 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4aaf41-e62a-4a4d-a9da-977a7f61ff9c None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:35.390837 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4aaf41-e62a-4a4d-a9da-977a7f61ff9c None admin] PATH_INFO: `/v3/domains` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:35.391554 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4aaf41-e62a-4a4d-a9da-977a7f61ff9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:28:35.391861 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4aaf41-e62a-4a4d-a9da-977a7f61ff9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:35.393281 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4aaf41-e62a-4a4d-a9da-977a7f61ff9c None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:35.404995 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 452/900] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 15:28:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:28:35.411622 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a6a2e1-b911-4ecd-a2ea-e671af0a2398 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:35.441562 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:35.517972 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a6a2e1-b911-4ecd-a2ea-e671af0a2398 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:35.553078 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd117dd9-e3d2-4d28-8f6e-40dc555456ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:35.553727 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd117dd9-e3d2-4d28-8f6e-40dc555456ae None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:35.554010 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd117dd9-e3d2-4d28-8f6e-40dc555456ae None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:35.554289 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd117dd9-e3d2-4d28-8f6e-40dc555456ae None admin] PATH_INFO: `/v3/users/placement` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:35.562378 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd117dd9-e3d2-4d28-8f6e-40dc555456ae None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:35.563908 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd117dd9-e3d2-4d28-8f6e-40dc555456ae None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:35.577190 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-fd117dd9-e3d2-4d28-8f6e-40dc555456ae None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 26 15:28:35.577190 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:28:35.577190 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:28:35.577190 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:28:35.577190 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:28:35.577190 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:28:35.577190 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:28:35.577190 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:28:35.577190 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:28:35.577190 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:28:35.577190 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:28:35.577190 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:28:35.577190 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 15:28:35.577190 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 15:28:35.577190 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 15:28:35.577190 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 15:28:35.587450 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:28:35.587450 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:28:35.587450 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 15:28:35.587450 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:28:35.587450 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 15:28:35.587450 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:28:35.587450 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:28:35.587450 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:28:35.587450 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:28:35.587450 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:28:35.587450 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:28:35.587450 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:28:35.587450 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:28:35.587450 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:28:35.587450 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:28:35.587450 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:28:35.587450 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:28:35.587450 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:28:35.588375 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:28:35.588375 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:28:35.588375 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 15:28:35.588375 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 15:28:35.588375 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 15:28:35.588375 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 15:28:35.588375 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 15:28:35.588375 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 15:28:35.588375 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 26 15:28:35.588375 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:28:35.588375 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 449/901] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 15:28:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 15:28:35.588954 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4aaf41-e62a-4a4d-a9da-977a7f61ff9c None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:35.588954 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:35.691191 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4aaf41-e62a-4a4d-a9da-977a7f61ff9c None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:35.726667 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab996d57-0a09-4a69-8471-e973bb7264d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:35.727336 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab996d57-0a09-4a69-8471-e973bb7264d9 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:35.727621 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab996d57-0a09-4a69-8471-e973bb7264d9 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:35.727899 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab996d57-0a09-4a69-8471-e973bb7264d9 None admin] PATH_INFO: `/v3/users` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:35.728691 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab996d57-0a09-4a69-8471-e973bb7264d9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:28:35.729002 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab996d57-0a09-4a69-8471-e973bb7264d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:35.730446 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab996d57-0a09-4a69-8471-e973bb7264d9 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:35.748259 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 453/902] 10.222.0.18 () {56 vars in 1143 bytes} [Tue Jul 26 15:28:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:28:35.754190 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd117dd9-e3d2-4d28-8f6e-40dc555456ae None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:35.843117 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:35.858693 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd117dd9-e3d2-4d28-8f6e-40dc555456ae None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:35.896912 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccec2a1-b073-4c66-82a1-35f421f6527c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:35.897548 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccec2a1-b073-4c66-82a1-35f421f6527c None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:35.897831 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccec2a1-b073-4c66-82a1-35f421f6527c None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:35.898104 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccec2a1-b073-4c66-82a1-35f421f6527c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:35.969178 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccec2a1-b073-4c66-82a1-35f421f6527c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:35.970659 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccec2a1-b073-4c66-82a1-35f421f6527c None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:36.059331 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:36.075708 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 450/903] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 15:28:35 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 15:28:36.082404 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab996d57-0a09-4a69-8471-e973bb7264d9 None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:36.142919 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:36.183338 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab996d57-0a09-4a69-8471-e973bb7264d9 None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:36.218541 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9f6df4-018e-4360-bcf4-986a879102ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:36.219345 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f6df4-018e-4360-bcf4-986a879102ac None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:36.219580 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f6df4-018e-4360-bcf4-986a879102ac None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:36.219857 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f6df4-018e-4360-bcf4-986a879102ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:36.230353 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9f6df4-018e-4360-bcf4-986a879102ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:36.232378 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9f6df4-018e-4360-bcf4-986a879102ac None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:36.247693 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application [None req-3f9f6df4-018e-4360-bcf4-986a879102ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:28:36.247693 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:28:36.247693 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:28:36.247693 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:28:36.247693 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:28:36.247693 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:28:36.247693 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:28:36.247693 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:28:36.247693 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:28:36.247693 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:28:36.247693 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:28:36.247693 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:28:36.247693 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:28:36.247693 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:28:36.247693 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:28:36.248874 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:28:36.248874 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:28:36.248874 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:28:36.248874 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:28:36.248874 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:28:36.248874 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:28:36.248874 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:28:36.248874 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:28:36.248874 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application with Lock( Jul 26 15:28:36.248874 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:28:36.248874 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:28:36.248874 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:28:36.248874 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:28:36.248874 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:28:36.248874 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:28:36.248874 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:28:36.248874 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:28:36.249928 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:28:36.249928 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:28:36.249928 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:28:36.249928 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:28:36.249928 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 454/904] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 15:28:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:28:36.255207 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccec2a1-b073-4c66-82a1-35f421f6527c None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:36.361062 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccec2a1-b073-4c66-82a1-35f421f6527c None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:36.397075 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e2142f-6953-4ec0-8dfd-0f57fc069b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:36.397706 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e2142f-6953-4ec0-8dfd-0f57fc069b33 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:36.397992 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e2142f-6953-4ec0-8dfd-0f57fc069b33 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:36.398331 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e2142f-6953-4ec0-8dfd-0f57fc069b33 None admin] PATH_INFO: `/v3/domains` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:36.399022 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e2142f-6953-4ec0-8dfd-0f57fc069b33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:28:36.399362 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e2142f-6953-4ec0-8dfd-0f57fc069b33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:36.400753 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e2142f-6953-4ec0-8dfd-0f57fc069b33 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:36.413237 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 451/905] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 15:28:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:28:36.419122 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9f6df4-018e-4360-bcf4-986a879102ac None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:36.519607 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9f6df4-018e-4360-bcf4-986a879102ac None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:36.533150 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:36.554207 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381d9600-374b-43ca-b126-2d010248636d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:36.554897 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d9600-374b-43ca-b126-2d010248636d None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:36.555204 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d9600-374b-43ca-b126-2d010248636d None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:36.555489 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d9600-374b-43ca-b126-2d010248636d None admin] PATH_INFO: `/v3/projects/service` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:36.563233 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381d9600-374b-43ca-b126-2d010248636d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:36.564717 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381d9600-374b-43ca-b126-2d010248636d None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:36.577479 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application [None req-381d9600-374b-43ca-b126-2d010248636d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:28:36.577479 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:28:36.577479 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:28:36.577479 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:28:36.577479 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:28:36.577479 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:28:36.577479 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:28:36.577479 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:28:36.577479 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:28:36.577479 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:28:36.577479 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:28:36.577479 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:28:36.577479 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 15:28:36.577479 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 15:28:36.577479 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 15:28:36.578686 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 15:28:36.578686 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:28:36.578686 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:28:36.578686 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:28:36.578686 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:28:36.578686 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:28:36.578686 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:28:36.578686 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:28:36.578686 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application with Lock( Jul 26 15:28:36.578686 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:28:36.578686 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:28:36.578686 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:28:36.578686 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:28:36.578686 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:28:36.578686 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:28:36.578686 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:28:36.578686 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:28:36.584998 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 15:28:36.584998 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 15:28:36.584998 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 15:28:36.584998 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 15:28:36.584998 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 15:28:36.584998 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 15:28:36.584998 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:28:36.584998 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: ERROR keystone.server.flask.application Jul 26 15:28:36.584998 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 455/906] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 15:28:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:28:36.585835 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e2142f-6953-4ec0-8dfd-0f57fc069b33 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:36.634750 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:36.687393 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e2142f-6953-4ec0-8dfd-0f57fc069b33 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:36.737541 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c440e9f6-10dc-42ee-b270-626d3a7ec618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:36.738624 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c440e9f6-10dc-42ee-b270-626d3a7ec618 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:36.739116 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c440e9f6-10dc-42ee-b270-626d3a7ec618 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:36.739640 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c440e9f6-10dc-42ee-b270-626d3a7ec618 None admin] PATH_INFO: `/v3/projects` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:36.741010 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c440e9f6-10dc-42ee-b270-626d3a7ec618 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:28:36.741558 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c440e9f6-10dc-42ee-b270-626d3a7ec618 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:36.744268 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c440e9f6-10dc-42ee-b270-626d3a7ec618 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:36.757752 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 452/907] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jul 26 15:28:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:28:36.764026 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381d9600-374b-43ca-b126-2d010248636d None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:36.870381 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381d9600-374b-43ca-b126-2d010248636d None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:36.910496 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d479b9eb-d81f-4e86-bac5-ed7b55396bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:36.911118 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d479b9eb-d81f-4e86-bac5-ed7b55396bd1 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:36.911433 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d479b9eb-d81f-4e86-bac5-ed7b55396bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:36.911707 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d479b9eb-d81f-4e86-bac5-ed7b55396bd1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:36.912503 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d479b9eb-d81f-4e86-bac5-ed7b55396bd1 None admin] RBAC: Adding query filter params (role.id=2c659645e15c4204b1457556939397cb, scope.project.id=9178e468facc41d6a7d828dfcd5301b4, user.id=21a7f59ebf1b40a1b76ee2002ae38230) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:28:36.912816 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d479b9eb-d81f-4e86-bac5-ed7b55396bd1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:36.914278 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d479b9eb-d81f-4e86-bac5-ed7b55396bd1 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:36.920871 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 456/908] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 26 15:28:36 2022] GET /identity/v3/role_assignments?user.id=21a7f59ebf1b40a1b76ee2002ae38230&scope.project.id=9178e468facc41d6a7d828dfcd5301b4&role.id=2c659645e15c4204b1457556939397cb => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:28:39.195408 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ecf30e-f5b0-4c49-a8ed-94b6e57c203f None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:39.195923 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ecf30e-f5b0-4c49-a8ed-94b6e57c203f None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:39.195923 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ecf30e-f5b0-4c49-a8ed-94b6e57c203f None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:39.197231 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 453/909] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:28:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:28:39.202911 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ecb6a-5a10-4d4f-81b8-c4ed29e10a92 None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:39.203459 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ecb6a-5a10-4d4f-81b8-c4ed29e10a92 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:39.203570 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ecb6a-5a10-4d4f-81b8-c4ed29e10a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:39.222698 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-ad6ecb6a-5a10-4d4f-81b8-c4ed29e10a92 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:28:39.224044 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-ad6ecb6a-5a10-4d4f-81b8-c4ed29e10a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:28:39.255759 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:39.293833 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 457/910] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:28:39 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 15:28:39.318572 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ecf30e-f5b0-4c49-a8ed-94b6e57c203f None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:39.431087 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ecf30e-f5b0-4c49-a8ed-94b6e57c203f None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:39.438963 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:39.467425 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341d9f58-4bbd-4629-9839-3f2f55df341e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:39.468125 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d9f58-4bbd-4629-9839-3f2f55df341e None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:39.468477 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d9f58-4bbd-4629-9839-3f2f55df341e None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:39.474135 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d9f58-4bbd-4629-9839-3f2f55df341e None admin] PATH_INFO: `/v3/services/placement` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:39.474135 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341d9f58-4bbd-4629-9839-3f2f55df341e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:39.474135 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341d9f58-4bbd-4629-9839-3f2f55df341e None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:39.480467 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-341d9f58-4bbd-4629-9839-3f2f55df341e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 15:28:39.480467 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:28:39.480467 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 15:28:39.480467 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 15:28:39.480467 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 15:28:39.480467 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 15:28:39.480467 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 15:28:39.480467 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 15:28:39.480467 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 15:28:39.480467 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:28:39.480467 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 15:28:39.480467 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:28:39.480467 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:28:39.480467 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:28:39.480467 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:28:39.480467 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:28:39.480467 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:28:39.481750 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:28:39.481750 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:28:39.481750 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:28:39.481750 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:28:39.481750 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:28:39.481750 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:28:39.481750 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 15:28:39.481750 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 15:28:39.481750 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 15:28:39.481750 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 15:28:39.481750 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:28:39.481750 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:28:39.481750 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:28:39.481750 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:28:39.481750 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:28:39.481750 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:28:39.482768 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:28:39.482768 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:28:39.482768 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:28:39.482768 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:28:39.482768 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:28:39.482768 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:28:39.482768 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:28:39.482768 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:28:39.482768 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:28:39.482768 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:28:39.482768 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 15:28:39.482768 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 15:28:39.482768 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 15:28:39.482768 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:28:39.482768 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 454/911] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Jul 26 15:28:39 2022] GET /identity/v3/services/placement => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:28:39.488720 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6ecb6a-5a10-4d4f-81b8-c4ed29e10a92 None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:39.590544 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6ecb6a-5a10-4d4f-81b8-c4ed29e10a92 None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:39.623828 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df53beb9-949f-4498-b748-c9dbecec031f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:39.624446 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df53beb9-949f-4498-b748-c9dbecec031f None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:39.624736 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df53beb9-949f-4498-b748-c9dbecec031f None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:39.625012 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df53beb9-949f-4498-b748-c9dbecec031f None admin] PATH_INFO: `/v3/services` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:39.625695 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df53beb9-949f-4498-b748-c9dbecec031f None admin] RBAC: Adding query filter params (name=placement) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:28:39.626009 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df53beb9-949f-4498-b748-c9dbecec031f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:39.627423 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df53beb9-949f-4498-b748-c9dbecec031f None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:39.632711 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 458/912] 10.222.0.18 () {56 vars in 1116 bytes} [Tue Jul 26 15:28:39 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:28:39.638513 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341d9f58-4bbd-4629-9839-3f2f55df341e None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:39.735162 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341d9f58-4bbd-4629-9839-3f2f55df341e None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:39.767944 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d50cfc-9612-4820-8c57-4c8c0e148fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:39.768555 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d50cfc-9612-4820-8c57-4c8c0e148fc5 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:39.768861 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d50cfc-9612-4820-8c57-4c8c0e148fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:39.769136 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d50cfc-9612-4820-8c57-4c8c0e148fc5 None admin] PATH_INFO: `/v3/services` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:39.769799 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d50cfc-9612-4820-8c57-4c8c0e148fc5 None admin] RBAC: Adding query filter params (type=placement) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:28:39.770102 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d50cfc-9612-4820-8c57-4c8c0e148fc5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:39.771538 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d50cfc-9612-4820-8c57-4c8c0e148fc5 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:39.775822 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 455/913] 10.222.0.18 () {56 vars in 1116 bytes} [Tue Jul 26 15:28:39 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:28:42.012539 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44170e79-8cc6-4733-8f8b-81280db4366c None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:42.013096 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44170e79-8cc6-4733-8f8b-81280db4366c None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:42.013096 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44170e79-8cc6-4733-8f8b-81280db4366c None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:42.014547 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 459/914] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:28:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:28:42.020346 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec49d799-53f0-41e0-9faf-3bab3fff3bc6 None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:42.023514 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec49d799-53f0-41e0-9faf-3bab3fff3bc6 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:42.023514 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec49d799-53f0-41e0-9faf-3bab3fff3bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:42.039706 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-ec49d799-53f0-41e0-9faf-3bab3fff3bc6 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:28:42.040917 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-ec49d799-53f0-41e0-9faf-3bab3fff3bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:28:42.068544 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:42.115321 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 456/915] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:28:42 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 15:28:42.139940 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44170e79-8cc6-4733-8f8b-81280db4366c None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:42.176247 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:42.253746 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44170e79-8cc6-4733-8f8b-81280db4366c None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:42.289182 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e88e5d-4894-4e64-bcab-37c43677319d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:42.289897 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e88e5d-4894-4e64-bcab-37c43677319d None admin] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:42.290178 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e88e5d-4894-4e64-bcab-37c43677319d None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:42.290451 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e88e5d-4894-4e64-bcab-37c43677319d None admin] PATH_INFO: `/v3/services` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:42.291428 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e88e5d-4894-4e64-bcab-37c43677319d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:42.292810 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e88e5d-4894-4e64-bcab-37c43677319d None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:42.432076 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 460/916] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Jul 26 15:28:42 2022] POST /identity/v3/services => generated 246 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:28:44.790072 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de0c5b8-28ce-4282-a0c1-e997a2cff585 None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:44.790694 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de0c5b8-28ce-4282-a0c1-e997a2cff585 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:44.790694 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de0c5b8-28ce-4282-a0c1-e997a2cff585 None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:44.792452 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 457/917] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:28:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:28:44.798166 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8d73c1-0bbb-4852-a506-e9db9ab83020 None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:44.798688 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8d73c1-0bbb-4852-a506-e9db9ab83020 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:44.798912 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8d73c1-0bbb-4852-a506-e9db9ab83020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:44.819333 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-3a8d73c1-0bbb-4852-a506-e9db9ab83020 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:28:44.820547 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-3a8d73c1-0bbb-4852-a506-e9db9ab83020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:28:44.907558 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 461/918] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:28:44 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 15:28:44.932123 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de0c5b8-28ce-4282-a0c1-e997a2cff585 None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:45.066602 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de0c5b8-28ce-4282-a0c1-e997a2cff585 None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:45.103355 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7972d56b-36c8-4838-8982-35d13171f479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:45.104030 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7972d56b-36c8-4838-8982-35d13171f479 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:45.104310 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7972d56b-36c8-4838-8982-35d13171f479 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:45.104580 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7972d56b-36c8-4838-8982-35d13171f479 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:45.105210 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7972d56b-36c8-4838-8982-35d13171f479 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:45.106704 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7972d56b-36c8-4838-8982-35d13171f479 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:45.116632 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-7972d56b-36c8-4838-8982-35d13171f479 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 15:28:45.116632 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:28:45.116632 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 15:28:45.116632 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 15:28:45.116632 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 15:28:45.116632 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 15:28:45.116632 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 15:28:45.116632 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 15:28:45.116632 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 15:28:45.116632 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:28:45.116632 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 15:28:45.116632 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:28:45.116632 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:28:45.116632 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:28:45.116632 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:28:45.116632 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:28:45.116632 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:28:45.118330 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:28:45.118330 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:28:45.118330 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:28:45.118330 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:28:45.118330 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:28:45.118330 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:28:45.118330 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 15:28:45.118330 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 15:28:45.118330 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 15:28:45.118330 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 15:28:45.118330 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:28:45.118330 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:28:45.118330 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:28:45.118330 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:28:45.118330 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:28:45.118330 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:28:45.119199 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:28:45.119199 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:28:45.119199 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:28:45.119199 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:28:45.119199 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:28:45.119199 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:28:45.119199 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:28:45.119199 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:28:45.119199 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:28:45.119199 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:28:45.119199 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 15:28:45.119199 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 15:28:45.119199 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 15:28:45.119199 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:28:45.119199 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 458/919] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Jul 26 15:28:44 2022] GET /identity/v3/services/placement => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:28:45.128466 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8d73c1-0bbb-4852-a506-e9db9ab83020 None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:45.160262 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:45.297653 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8d73c1-0bbb-4852-a506-e9db9ab83020 None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:45.344419 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771542cc-7e2b-450b-86cc-29393cd7c6ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:45.344965 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771542cc-7e2b-450b-86cc-29393cd7c6ce None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:45.345250 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771542cc-7e2b-450b-86cc-29393cd7c6ce None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:45.345530 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771542cc-7e2b-450b-86cc-29393cd7c6ce None admin] PATH_INFO: `/v3/services` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:45.346221 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771542cc-7e2b-450b-86cc-29393cd7c6ce None admin] RBAC: Adding query filter params (name=placement) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:28:45.346644 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771542cc-7e2b-450b-86cc-29393cd7c6ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:45.348081 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771542cc-7e2b-450b-86cc-29393cd7c6ce None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:45.355064 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 462/920] 10.222.0.18 () {56 vars in 1116 bytes} [Tue Jul 26 15:28:45 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:28:45.362219 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7972d56b-36c8-4838-8982-35d13171f479 None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:45.395638 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:45.469845 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7972d56b-36c8-4838-8982-35d13171f479 None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:45.505547 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aa2e8b-04b3-4b1e-866f-4c0abc1c42b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:45.506185 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa2e8b-04b3-4b1e-866f-4c0abc1c42b1 None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:45.506466 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa2e8b-04b3-4b1e-866f-4c0abc1c42b1 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:45.506738 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa2e8b-04b3-4b1e-866f-4c0abc1c42b1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:45.507774 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aa2e8b-04b3-4b1e-866f-4c0abc1c42b1 None admin] RBAC: Adding query filter params (interface=public, service_id=03f98789bc10479c9e4f2274fa99a296, region_id=RegionOne) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:28:45.508107 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aa2e8b-04b3-4b1e-866f-4c0abc1c42b1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:45.509565 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aa2e8b-04b3-4b1e-866f-4c0abc1c42b1 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:45.515606 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 459/921] 10.222.0.18 () {56 vars in 1251 bytes} [Tue Jul 26 15:28:45 2022] GET /identity/v3/endpoints?service_id=03f98789bc10479c9e4f2274fa99a296&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:28:45.522216 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771542cc-7e2b-450b-86cc-29393cd7c6ce None admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:45.620091 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:45.641674 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771542cc-7e2b-450b-86cc-29393cd7c6ce None admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:45.678938 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d40048f-72f8-4e0c-9124-5a9c1712e2b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:45.679617 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d40048f-72f8-4e0c-9124-5a9c1712e2b3 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:45.679907 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d40048f-72f8-4e0c-9124-5a9c1712e2b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:45.680184 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d40048f-72f8-4e0c-9124-5a9c1712e2b3 None admin] PATH_INFO: `/v3/services` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:45.680858 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d40048f-72f8-4e0c-9124-5a9c1712e2b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:45.682257 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d40048f-72f8-4e0c-9124-5a9c1712e2b3 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:45.689636 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 463/922] 10.222.0.18 () {56 vars in 1087 bytes} [Tue Jul 26 15:28:45 2022] GET /identity/v3/services => generated 1962 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:28:47.978349 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43191bf-cae2-4b30-9767-e54bf2982d73 None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:47.978957 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43191bf-cae2-4b30-9767-e54bf2982d73 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:47.978957 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43191bf-cae2-4b30-9767-e54bf2982d73 None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:47.980432 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 460/923] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:28:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:28:47.985783 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b876b8-0f57-46b2-8d5a-55bdbaccd1c7 None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:47.986490 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b876b8-0f57-46b2-8d5a-55bdbaccd1c7 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:47.986490 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b876b8-0f57-46b2-8d5a-55bdbaccd1c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:48.004491 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-62b876b8-0f57-46b2-8d5a-55bdbaccd1c7 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:28:48.005824 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-62b876b8-0f57-46b2-8d5a-55bdbaccd1c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:28:48.073398 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 464/924] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:28:47 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 15:28:48.102534 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43191bf-cae2-4b30-9767-e54bf2982d73 None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:48.194911 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:48.204276 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43191bf-cae2-4b30-9767-e54bf2982d73 None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:48.237062 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65839c93-6669-4fc8-96f5-0ea7ea824a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:48.237710 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65839c93-6669-4fc8-96f5-0ea7ea824a5e None admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:48.237996 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65839c93-6669-4fc8-96f5-0ea7ea824a5e None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:48.238276 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65839c93-6669-4fc8-96f5-0ea7ea824a5e None admin] PATH_INFO: `/v3/services/placement` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:48.238898 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65839c93-6669-4fc8-96f5-0ea7ea824a5e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:48.240327 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65839c93-6669-4fc8-96f5-0ea7ea824a5e None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:48.251353 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application [None req-65839c93-6669-4fc8-96f5-0ea7ea824a5e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 15:28:48.251353 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:28:48.251353 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 15:28:48.251353 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 15:28:48.251353 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 15:28:48.251353 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 15:28:48.251353 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 15:28:48.251353 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 15:28:48.251353 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 15:28:48.251353 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:28:48.251353 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 15:28:48.251353 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:28:48.251353 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:28:48.251353 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:28:48.251353 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:28:48.251353 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:28:48.251353 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:28:48.253115 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:28:48.253115 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:28:48.253115 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:28:48.253115 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:28:48.253115 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:28:48.253115 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:28:48.253115 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 15:28:48.253115 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 15:28:48.253115 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 15:28:48.253115 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 15:28:48.253115 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:28:48.253115 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:28:48.253115 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:28:48.253115 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:28:48.253115 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:28:48.253115 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:28:48.254027 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:28:48.254027 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application with Lock( Jul 26 15:28:48.254027 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:28:48.254027 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:28:48.254027 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:28:48.254027 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:28:48.254027 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:28:48.254027 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:28:48.254027 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:28:48.254027 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:28:48.254027 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 15:28:48.254027 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 15:28:48.254027 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 15:28:48.254027 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: ERROR keystone.server.flask.application Jul 26 15:28:48.254027 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 461/925] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Jul 26 15:28:48 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 15:28:48.259104 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b876b8-0f57-46b2-8d5a-55bdbaccd1c7 None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:48.340643 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:48.363381 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b876b8-0f57-46b2-8d5a-55bdbaccd1c7 None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:48.399276 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fa4d7f-fa84-4c33-a5fe-65e840949930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:48.399916 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa4d7f-fa84-4c33-a5fe-65e840949930 None admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:48.400299 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa4d7f-fa84-4c33-a5fe-65e840949930 None admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:48.400580 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa4d7f-fa84-4c33-a5fe-65e840949930 None admin] PATH_INFO: `/v3/services` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:48.401255 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fa4d7f-fa84-4c33-a5fe-65e840949930 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:28:48.401560 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fa4d7f-fa84-4c33-a5fe-65e840949930 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:48.402924 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fa4d7f-fa84-4c33-a5fe-65e840949930 None admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:48.407986 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 465/926] 10.222.0.18 () {56 vars in 1116 bytes} [Tue Jul 26 15:28:48 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:28:48.414375 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65839c93-6669-4fc8-96f5-0ea7ea824a5e None admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:48.522003 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65839c93-6669-4fc8-96f5-0ea7ea824a5e None admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:48.556417 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd9a559-24fa-4914-bafb-8c648dcfd372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:48.557041 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd9a559-24fa-4914-bafb-8c648dcfd372 None admin] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:48.557327 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd9a559-24fa-4914-bafb-8c648dcfd372 None admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:48.557604 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd9a559-24fa-4914-bafb-8c648dcfd372 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:48.558308 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd9a559-24fa-4914-bafb-8c648dcfd372 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:48.559759 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd9a559-24fa-4914-bafb-8c648dcfd372 None admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:48.694867 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 462/927] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Jul 26 15:28:48 2022] POST /identity/v3/endpoints => generated 331 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:28:58.486867 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=30 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:58.688879 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:37:25.067163 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5ee039-88ca-4af6-8b01-714403e9b07d None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:37:25.067961 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5ee039-88ca-4af6-8b01-714403e9b07d None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:37:25.067961 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5ee039-88ca-4af6-8b01-714403e9b07d None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:37:25.069204 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 466/928] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:37:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 15:37:25.076901 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7bc87-7ba7-4038-b29f-4bf075565c50 None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:37:25.077721 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7bc87-7ba7-4038-b29f-4bf075565c50 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:37:25.077721 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7bc87-7ba7-4038-b29f-4bf075565c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:37:25.198916 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-f9d7bc87-7ba7-4038-b29f-4bf075565c50 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:37:25.200427 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-f9d7bc87-7ba7-4038-b29f-4bf075565c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:37:25.411647 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 463/929] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:37:25 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:37:25.473689 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d511d7bf-0d0f-4440-b8dc-bb5b599c51e7 None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:37:25.473689 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d511d7bf-0d0f-4440-b8dc-bb5b599c51e7 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:37:25.473689 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d511d7bf-0d0f-4440-b8dc-bb5b599c51e7 None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:37:25.475235 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 467/930] 10.222.0.18 () {54 vars in 965 bytes} [Tue Jul 26 15:37:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:37:25.485839 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3383fb36-20e6-46f4-be88-3efb0ddd38b7 None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:37:25.486346 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3383fb36-20e6-46f4-be88-3efb0ddd38b7 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:37:25.486859 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3383fb36-20e6-46f4-be88-3efb0ddd38b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:37:25.586000 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-3383fb36-20e6-46f4-be88-3efb0ddd38b7 None None] MFA Rules not processed for user `960c230d1e8841e6b231fdbf4d172cc6`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:37:25.587263 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-3383fb36-20e6-46f4-be88-3efb0ddd38b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:37:25.625863 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:37:25.684397 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 464/931] 10.222.0.18 () {58 vars in 1062 bytes} [Tue Jul 26 15:37:25 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:37:25.695486 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d511d7bf-0d0f-4440-b8dc-bb5b599c51e7 None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:37:25.706500 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d511d7bf-0d0f-4440-b8dc-bb5b599c51e7 None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:37:25.710728 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645000b7-3fab-450f-aecc-872049d3eaed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960c230d1e8841e6b231fdbf4d172cc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9178e468facc41d6a7d828dfcd5301b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:37:25.711493 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645000b7-3fab-450f-aecc-872049d3eaed service neutron] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:37:25.711775 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645000b7-3fab-450f-aecc-872049d3eaed service neutron] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:37:25.712414 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645000b7-3fab-450f-aecc-872049d3eaed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:37:25.725250 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645000b7-3fab-450f-aecc-872049d3eaed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:37:25.727447 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645000b7-3fab-450f-aecc-872049d3eaed service neutron] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:37:25.739848 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 468/932] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 15:37:25 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:37:28.371577 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b841407-a7cd-4ed7-b226-34c2c3d63976 None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:37:28.372127 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b841407-a7cd-4ed7-b226-34c2c3d63976 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:37:28.372127 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b841407-a7cd-4ed7-b226-34c2c3d63976 None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:37:28.373803 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 465/933] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:37:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:37:28.379425 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c176766-4bb1-4301-9b5a-59b648e66317 None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:37:28.381071 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c176766-4bb1-4301-9b5a-59b648e66317 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:37:28.381071 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c176766-4bb1-4301-9b5a-59b648e66317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:37:28.404626 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-6c176766-4bb1-4301-9b5a-59b648e66317 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:37:28.405899 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-6c176766-4bb1-4301-9b5a-59b648e66317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:37:28.414832 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 469/934] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:37:28 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:37:28.455247 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b841407-a7cd-4ed7-b226-34c2c3d63976 None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:37:28.467518 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b841407-a7cd-4ed7-b226-34c2c3d63976 None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:37:28.471486 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e85564b-cebd-497d-b653-2fc517fd8ecd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960c230d1e8841e6b231fdbf4d172cc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9178e468facc41d6a7d828dfcd5301b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:37:28.472116 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85564b-cebd-497d-b653-2fc517fd8ecd service neutron] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:37:28.472518 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85564b-cebd-497d-b653-2fc517fd8ecd service neutron] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:37:28.472715 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85564b-cebd-497d-b653-2fc517fd8ecd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:37:28.482909 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e85564b-cebd-497d-b653-2fc517fd8ecd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:37:28.484524 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e85564b-cebd-497d-b653-2fc517fd8ecd service neutron] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:37:28.496080 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 466/935] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 15:37:28 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:37:31.366811 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc45abad-9931-4d02-8244-46c220f3e706 None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:37:31.367420 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc45abad-9931-4d02-8244-46c220f3e706 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:37:31.367420 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc45abad-9931-4d02-8244-46c220f3e706 None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:37:31.368742 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 470/936] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:37:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:37:31.374086 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506fb779-2680-4fab-9b75-f28293a6bdaa None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:37:31.374536 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506fb779-2680-4fab-9b75-f28293a6bdaa None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:37:31.374644 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506fb779-2680-4fab-9b75-f28293a6bdaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:37:31.441452 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-506fb779-2680-4fab-9b75-f28293a6bdaa None None] MFA Rules not processed for user `d861ca5a090d4492861528dc158b6822`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:37:31.442669 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-506fb779-2680-4fab-9b75-f28293a6bdaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:37:31.526550 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 467/937] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:37:31 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:37:31.567054 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc45abad-9931-4d02-8244-46c220f3e706 None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:37:31.578642 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc45abad-9931-4d02-8244-46c220f3e706 None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:37:31.582601 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2646ca-973d-46ca-a072-69319c0f516d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960c230d1e8841e6b231fdbf4d172cc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9178e468facc41d6a7d828dfcd5301b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:37:31.583310 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2646ca-973d-46ca-a072-69319c0f516d service neutron] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:37:31.583654 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2646ca-973d-46ca-a072-69319c0f516d service neutron] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:37:31.583994 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2646ca-973d-46ca-a072-69319c0f516d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:37:31.592857 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2646ca-973d-46ca-a072-69319c0f516d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:37:31.594313 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2646ca-973d-46ca-a072-69319c0f516d service neutron] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:37:31.603719 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 471/938] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 15:37:31 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:37:34.758728 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650d98c4-197b-4a31-986f-67ff34058a42 None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:37:34.759407 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650d98c4-197b-4a31-986f-67ff34058a42 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:37:34.759407 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650d98c4-197b-4a31-986f-67ff34058a42 None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:37:34.760687 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 468/939] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:37:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:37:34.765898 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fbb43d-70e0-42d4-88e6-ba142c6a50a1 None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:37:34.766329 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fbb43d-70e0-42d4-88e6-ba142c6a50a1 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:37:34.766444 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fbb43d-70e0-42d4-88e6-ba142c6a50a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:37:34.785150 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-83fbb43d-70e0-42d4-88e6-ba142c6a50a1 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:37:34.786374 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-83fbb43d-70e0-42d4-88e6-ba142c6a50a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:37:34.855002 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 472/940] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:37:34 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:37:34.895778 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650d98c4-197b-4a31-986f-67ff34058a42 None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:37:34.906383 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650d98c4-197b-4a31-986f-67ff34058a42 None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:37:34.910144 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a20bfb3-2065-4184-9529-d88b92ca9229 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960c230d1e8841e6b231fdbf4d172cc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9178e468facc41d6a7d828dfcd5301b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:37:34.910891 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20bfb3-2065-4184-9529-d88b92ca9229 service neutron] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:37:34.911221 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20bfb3-2065-4184-9529-d88b92ca9229 service neutron] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:37:34.911502 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20bfb3-2065-4184-9529-d88b92ca9229 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:37:34.921741 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a20bfb3-2065-4184-9529-d88b92ca9229 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:37:34.923290 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a20bfb3-2065-4184-9529-d88b92ca9229 service neutron] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:37:34.934704 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 469/941] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 15:37:34 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:37:38.359815 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7d3d7-8431-4cd4-b13d-f4a3dcb0b24f None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:37:38.360498 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7d3d7-8431-4cd4-b13d-f4a3dcb0b24f None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:37:38.360498 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7d3d7-8431-4cd4-b13d-f4a3dcb0b24f None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:37:38.361949 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 473/942] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:37:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 15:37:38.367295 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec4aa3a-2239-4ff1-9fb6-994145ccdf63 None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:37:38.367788 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec4aa3a-2239-4ff1-9fb6-994145ccdf63 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:37:38.367888 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec4aa3a-2239-4ff1-9fb6-994145ccdf63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:37:38.387686 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-2ec4aa3a-2239-4ff1-9fb6-994145ccdf63 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:37:38.388923 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-2ec4aa3a-2239-4ff1-9fb6-994145ccdf63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:37:38.397483 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 470/943] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:37:38 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:37:38.447576 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe86f3-96a4-477b-b4c3-cb38e4ef53e2 None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:37:38.447959 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe86f3-96a4-477b-b4c3-cb38e4ef53e2 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:37:38.448311 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe86f3-96a4-477b-b4c3-cb38e4ef53e2 None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:37:38.449737 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 474/944] 10.222.0.18 () {54 vars in 965 bytes} [Tue Jul 26 15:37:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 15:37:38.455677 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b570821-531c-4d3f-9950-aaee88e18de6 None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:37:38.455981 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b570821-531c-4d3f-9950-aaee88e18de6 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:37:38.456244 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b570821-531c-4d3f-9950-aaee88e18de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:37:38.476382 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-7b570821-531c-4d3f-9950-aaee88e18de6 None None] MFA Rules not processed for user `960c230d1e8841e6b231fdbf4d172cc6`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:37:38.477605 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-7b570821-531c-4d3f-9950-aaee88e18de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:37:38.484134 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 471/945] 10.222.0.18 () {58 vars in 1062 bytes} [Tue Jul 26 15:37:38 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:37:38.493731 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe86f3-96a4-477b-b4c3-cb38e4ef53e2 None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:37:38.505146 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe86f3-96a4-477b-b4c3-cb38e4ef53e2 None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:37:38.509450 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a89198-00d2-4c11-87b4-2749394d9b16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960c230d1e8841e6b231fdbf4d172cc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9178e468facc41d6a7d828dfcd5301b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:37:38.510070 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a89198-00d2-4c11-87b4-2749394d9b16 service neutron] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:37:38.510364 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a89198-00d2-4c11-87b4-2749394d9b16 service neutron] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:37:38.510641 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a89198-00d2-4c11-87b4-2749394d9b16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:37:38.520453 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a89198-00d2-4c11-87b4-2749394d9b16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:37:38.521904 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a89198-00d2-4c11-87b4-2749394d9b16 service neutron] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:37:38.532142 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 475/946] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 15:37:38 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:37:41.188423 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0772c10-43e2-44aa-9c8c-2ca97e4d93ba None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:37:41.188989 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0772c10-43e2-44aa-9c8c-2ca97e4d93ba None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:37:41.189337 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0772c10-43e2-44aa-9c8c-2ca97e4d93ba None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:37:41.191955 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 472/947] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:37:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:37:41.201377 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19000c85-8c08-4e70-8833-a12f95ffbec2 None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:37:41.202005 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19000c85-8c08-4e70-8833-a12f95ffbec2 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:37:41.202323 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19000c85-8c08-4e70-8833-a12f95ffbec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:37:41.226342 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-19000c85-8c08-4e70-8833-a12f95ffbec2 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:37:41.227588 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-19000c85-8c08-4e70-8833-a12f95ffbec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:37:41.236277 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 476/948] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:37:41 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:37:41.276901 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0772c10-43e2-44aa-9c8c-2ca97e4d93ba None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:37:41.287822 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0772c10-43e2-44aa-9c8c-2ca97e4d93ba None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:37:41.291434 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073955e6-21d0-4c92-bc47-bb5537cf0626 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960c230d1e8841e6b231fdbf4d172cc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9178e468facc41d6a7d828dfcd5301b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:37:41.292048 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073955e6-21d0-4c92-bc47-bb5537cf0626 service neutron] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:37:41.292329 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073955e6-21d0-4c92-bc47-bb5537cf0626 service neutron] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:37:41.292596 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073955e6-21d0-4c92-bc47-bb5537cf0626 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:37:41.302056 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073955e6-21d0-4c92-bc47-bb5537cf0626 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:37:41.304082 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073955e6-21d0-4c92-bc47-bb5537cf0626 service neutron] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:37:41.314443 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 473/949] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 15:37:41 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:37:43.651287 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f5b86a-578e-493f-8563-fd1e692c02c0 None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:37:43.651792 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f5b86a-578e-493f-8563-fd1e692c02c0 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:37:43.651881 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f5b86a-578e-493f-8563-fd1e692c02c0 None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:37:43.653370 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 477/950] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:37:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:37:43.658786 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f349bba-ac37-47bc-92fb-fc35cd963cbd None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:37:43.659287 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f349bba-ac37-47bc-92fb-fc35cd963cbd None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:37:43.659501 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f349bba-ac37-47bc-92fb-fc35cd963cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:37:43.680486 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-4f349bba-ac37-47bc-92fb-fc35cd963cbd None None] MFA Rules not processed for user `d861ca5a090d4492861528dc158b6822`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:37:43.681794 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-4f349bba-ac37-47bc-92fb-fc35cd963cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:37:43.689534 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 474/951] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:37:43 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:37:43.728738 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f5b86a-578e-493f-8563-fd1e692c02c0 None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:37:43.742825 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f5b86a-578e-493f-8563-fd1e692c02c0 None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:37:43.746385 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b10f6f-6835-4a12-a72e-7bc4f1cdd083 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960c230d1e8841e6b231fdbf4d172cc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9178e468facc41d6a7d828dfcd5301b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:37:43.746996 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b10f6f-6835-4a12-a72e-7bc4f1cdd083 service neutron] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:37:43.747312 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b10f6f-6835-4a12-a72e-7bc4f1cdd083 service neutron] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:37:43.747589 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b10f6f-6835-4a12-a72e-7bc4f1cdd083 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:37:43.757208 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b10f6f-6835-4a12-a72e-7bc4f1cdd083 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:37:43.758644 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b10f6f-6835-4a12-a72e-7bc4f1cdd083 service neutron] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:37:43.769470 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 478/952] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 15:37:43 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:37:46.595254 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c8c3f6-a9c4-437d-8e83-3f1b1ae6a966 None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:37:46.595784 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c8c3f6-a9c4-437d-8e83-3f1b1ae6a966 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:37:46.595784 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c8c3f6-a9c4-437d-8e83-3f1b1ae6a966 None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:37:46.597406 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 475/953] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:37:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:37:46.603327 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e1749b-5332-4f9b-84e2-f4708dd9e153 None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:37:46.603750 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e1749b-5332-4f9b-84e2-f4708dd9e153 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:37:46.603870 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e1749b-5332-4f9b-84e2-f4708dd9e153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:37:46.624284 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-d8e1749b-5332-4f9b-84e2-f4708dd9e153 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:37:46.625543 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-d8e1749b-5332-4f9b-84e2-f4708dd9e153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:37:46.633710 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 479/954] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:37:46 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:37:46.672931 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c8c3f6-a9c4-437d-8e83-3f1b1ae6a966 None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:37:46.679649 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:37:46.684130 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c8c3f6-a9c4-437d-8e83-3f1b1ae6a966 None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:37:46.687681 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221a640a-bf89-4f05-8136-8b2ec72a04a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960c230d1e8841e6b231fdbf4d172cc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9178e468facc41d6a7d828dfcd5301b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:37:46.688301 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a640a-bf89-4f05-8136-8b2ec72a04a0 service neutron] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:37:46.689213 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a640a-bf89-4f05-8136-8b2ec72a04a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:37:46.698626 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a640a-bf89-4f05-8136-8b2ec72a04a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:37:46.699636 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221a640a-bf89-4f05-8136-8b2ec72a04a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:37:46.701125 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221a640a-bf89-4f05-8136-8b2ec72a04a0 service neutron] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:37:46.711981 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 476/955] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 15:37:46 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:37:49.043762 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a06e0b8-1736-49dd-be9c-7d5d45a6b7e0 None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:37:49.044466 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a06e0b8-1736-49dd-be9c-7d5d45a6b7e0 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:37:49.044466 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a06e0b8-1736-49dd-be9c-7d5d45a6b7e0 None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:37:49.045838 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 480/956] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:37:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:37:49.051432 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83fbdf2-1838-41b7-88ed-5a2009ce4818 None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:37:49.051876 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83fbdf2-1838-41b7-88ed-5a2009ce4818 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:37:49.052132 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83fbdf2-1838-41b7-88ed-5a2009ce4818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:37:49.072456 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-b83fbdf2-1838-41b7-88ed-5a2009ce4818 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:37:49.073649 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-b83fbdf2-1838-41b7-88ed-5a2009ce4818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:37:49.081456 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 477/957] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:37:49 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:37:49.123694 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a06e0b8-1736-49dd-be9c-7d5d45a6b7e0 None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:37:49.129477 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=65 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:37:49.136844 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a06e0b8-1736-49dd-be9c-7d5d45a6b7e0 None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:37:49.141055 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9552ba40-01a6-4eeb-9e3a-96803c8184ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960c230d1e8841e6b231fdbf4d172cc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9178e468facc41d6a7d828dfcd5301b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:37:49.141759 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9552ba40-01a6-4eeb-9e3a-96803c8184ed service neutron] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:37:49.142159 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9552ba40-01a6-4eeb-9e3a-96803c8184ed service neutron] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:37:49.142459 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9552ba40-01a6-4eeb-9e3a-96803c8184ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:37:49.153038 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9552ba40-01a6-4eeb-9e3a-96803c8184ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:37:49.154546 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9552ba40-01a6-4eeb-9e3a-96803c8184ed service neutron] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:37:49.165375 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 481/958] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 15:37:49 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:37:52.468042 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d32e66c-e965-4129-9c76-2420c90c8476 None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:37:52.468600 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d32e66c-e965-4129-9c76-2420c90c8476 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:37:52.468600 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d32e66c-e965-4129-9c76-2420c90c8476 None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:37:52.469987 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 478/959] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:37:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:37:52.476164 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c60408-81ea-40c8-a61a-4b15b614703e None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:37:52.476753 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c60408-81ea-40c8-a61a-4b15b614703e None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:37:52.476753 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c60408-81ea-40c8-a61a-4b15b614703e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:37:52.496792 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-34c60408-81ea-40c8-a61a-4b15b614703e None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:37:52.498012 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-34c60408-81ea-40c8-a61a-4b15b614703e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:37:52.506137 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 482/960] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:37:52 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:37:52.544839 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d32e66c-e965-4129-9c76-2420c90c8476 None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:37:52.555449 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d32e66c-e965-4129-9c76-2420c90c8476 None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:37:52.558993 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd41230-5665-4c8f-955f-e4a6290349cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960c230d1e8841e6b231fdbf4d172cc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9178e468facc41d6a7d828dfcd5301b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:37:52.559619 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd41230-5665-4c8f-955f-e4a6290349cf service neutron] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:37:52.559898 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd41230-5665-4c8f-955f-e4a6290349cf service neutron] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:37:52.560169 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd41230-5665-4c8f-955f-e4a6290349cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:37:52.569114 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd41230-5665-4c8f-955f-e4a6290349cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:37:52.570567 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd41230-5665-4c8f-955f-e4a6290349cf service neutron] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:37:52.579858 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 479/961] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 15:37:52 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:37:57.413553 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a68a2b-56f9-4705-bd50-2fd40d1c44fd None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:37:57.414084 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a68a2b-56f9-4705-bd50-2fd40d1c44fd None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:37:57.414084 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a68a2b-56f9-4705-bd50-2fd40d1c44fd None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:37:57.415590 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 483/962] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:37:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:37:57.421554 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4247617-c3b2-4ee1-a85f-142d88b25668 None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:37:57.422098 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4247617-c3b2-4ee1-a85f-142d88b25668 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:37:57.422098 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4247617-c3b2-4ee1-a85f-142d88b25668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:37:57.444684 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-d4247617-c3b2-4ee1-a85f-142d88b25668 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:37:57.446722 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-d4247617-c3b2-4ee1-a85f-142d88b25668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:37:57.459779 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 480/963] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:37:57 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:37:57.515977 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a68a2b-56f9-4705-bd50-2fd40d1c44fd None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:37:57.530818 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a68a2b-56f9-4705-bd50-2fd40d1c44fd None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:37:57.535949 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6984bb26-d7f0-4ba9-b010-ba0b641b88b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960c230d1e8841e6b231fdbf4d172cc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9178e468facc41d6a7d828dfcd5301b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:37:57.537453 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6984bb26-d7f0-4ba9-b010-ba0b641b88b6 service neutron] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:37:57.537658 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6984bb26-d7f0-4ba9-b010-ba0b641b88b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:37:57.538493 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6984bb26-d7f0-4ba9-b010-ba0b641b88b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:37:57.550236 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6984bb26-d7f0-4ba9-b010-ba0b641b88b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:37:57.552036 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6984bb26-d7f0-4ba9-b010-ba0b641b88b6 service neutron] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:37:57.565832 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 484/964] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 15:37:57 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:38:01.530851 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd6a955-738a-4f17-9e0c-d3a965a260fb None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:38:01.531767 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd6a955-738a-4f17-9e0c-d3a965a260fb None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:38:01.531767 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd6a955-738a-4f17-9e0c-d3a965a260fb None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:38:01.533069 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 481/965] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:38:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:38:01.540057 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c86b4a-5035-4321-be15-43367d8fc633 None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:38:01.540889 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c86b4a-5035-4321-be15-43367d8fc633 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:38:01.541078 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c86b4a-5035-4321-be15-43367d8fc633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:38:01.564702 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-e1c86b4a-5035-4321-be15-43367d8fc633 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:38:01.566166 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-e1c86b4a-5035-4321-be15-43367d8fc633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:38:01.575238 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 485/966] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:38:01 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:38:01.616894 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd6a955-738a-4f17-9e0c-d3a965a260fb None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:38:01.628994 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd6a955-738a-4f17-9e0c-d3a965a260fb None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:38:01.634126 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc9a3be-379f-45f5-a7e3-3ba3d61b51cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960c230d1e8841e6b231fdbf4d172cc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9178e468facc41d6a7d828dfcd5301b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:38:01.637197 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc9a3be-379f-45f5-a7e3-3ba3d61b51cf service neutron] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:38:01.637197 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc9a3be-379f-45f5-a7e3-3ba3d61b51cf service neutron] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:38:01.637197 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc9a3be-379f-45f5-a7e3-3ba3d61b51cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:38:01.646885 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc9a3be-379f-45f5-a7e3-3ba3d61b51cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:38:01.649201 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc9a3be-379f-45f5-a7e3-3ba3d61b51cf service neutron] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:38:01.663535 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 482/967] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 15:38:01 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:38:07.604098 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55f2e0-2406-4402-b8b6-78b225432fdf None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:38:07.604647 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55f2e0-2406-4402-b8b6-78b225432fdf None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:38:07.605172 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55f2e0-2406-4402-b8b6-78b225432fdf None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:38:07.607929 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 486/968] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:38:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 15:38:07.616526 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4d812-2e96-497b-b3b1-67398b688f4c None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:38:07.617353 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4d812-2e96-497b-b3b1-67398b688f4c None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:38:07.617353 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4d812-2e96-497b-b3b1-67398b688f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:38:07.641408 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-01d4d812-2e96-497b-b3b1-67398b688f4c None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:38:07.642712 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-01d4d812-2e96-497b-b3b1-67398b688f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:38:07.654060 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 483/969] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:38:07 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:38:07.698116 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e55f2e0-2406-4402-b8b6-78b225432fdf None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:38:07.710045 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e55f2e0-2406-4402-b8b6-78b225432fdf None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:38:07.713611 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c530ea15-ae4a-4251-a4b8-ff8d6b37b6fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960c230d1e8841e6b231fdbf4d172cc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9178e468facc41d6a7d828dfcd5301b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:38:07.714236 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c530ea15-ae4a-4251-a4b8-ff8d6b37b6fa service neutron] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:38:07.714517 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c530ea15-ae4a-4251-a4b8-ff8d6b37b6fa service neutron] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:38:07.714785 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c530ea15-ae4a-4251-a4b8-ff8d6b37b6fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:38:07.724651 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c530ea15-ae4a-4251-a4b8-ff8d6b37b6fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:38:07.726092 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c530ea15-ae4a-4251-a4b8-ff8d6b37b6fa service neutron] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:38:07.736437 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 487/970] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 15:38:07 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:38:13.383669 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a59d1-a174-4ba6-bba1-9a27b8965b43 None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:38:13.383669 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a59d1-a174-4ba6-bba1-9a27b8965b43 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:38:13.383669 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a59d1-a174-4ba6-bba1-9a27b8965b43 None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:38:13.383669 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 484/971] 10.222.0.18 () {54 vars in 921 bytes} [Tue Jul 26 15:38:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:38:13.384357 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d52eb4c-77c6-4067-a054-679d3e6fe148 None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:38:13.384718 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d52eb4c-77c6-4067-a054-679d3e6fe148 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:38:13.399057 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d52eb4c-77c6-4067-a054-679d3e6fe148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:38:13.444827 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-3d52eb4c-77c6-4067-a054-679d3e6fe148 None None] MFA Rules not processed for user `21a7f59ebf1b40a1b76ee2002ae38230`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:38:13.446062 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-3d52eb4c-77c6-4067-a054-679d3e6fe148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:38:13.575985 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 488/972] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Jul 26 15:38:13 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:38:17.636177 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=25 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:38:18.177746 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1671c24d-29bf-4625-93d9-56c09e50b342 None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:38:18.178293 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1671c24d-29bf-4625-93d9-56c09e50b342 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:38:18.178718 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1671c24d-29bf-4625-93d9-56c09e50b342 None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:38:18.180303 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 485/973] 10.222.0.18 () {54 vars in 921 bytes} [Tue Jul 26 15:38:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:38:18.186253 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b48e4a-3379-47b2-bc26-adb4249e1f9f None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:38:18.186733 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b48e4a-3379-47b2-bc26-adb4249e1f9f None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:38:18.186733 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b48e4a-3379-47b2-bc26-adb4249e1f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:38:18.207246 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-c7b48e4a-3379-47b2-bc26-adb4249e1f9f None None] MFA Rules not processed for user `21a7f59ebf1b40a1b76ee2002ae38230`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:38:18.208482 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-c7b48e4a-3379-47b2-bc26-adb4249e1f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:38:18.217431 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 489/974] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Jul 26 15:38:18 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:38:20.005329 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b0b613-e48c-4cb9-aaed-5f5935109c6a None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:38:20.005855 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b0b613-e48c-4cb9-aaed-5f5935109c6a None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:38:20.005980 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b0b613-e48c-4cb9-aaed-5f5935109c6a None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:38:20.007319 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 486/975] 10.222.0.18 () {54 vars in 921 bytes} [Tue Jul 26 15:38:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:38:20.013179 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab081d3-1057-47cb-bb0f-809b7aac0ab6 None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:38:20.013673 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab081d3-1057-47cb-bb0f-809b7aac0ab6 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:38:20.013764 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab081d3-1057-47cb-bb0f-809b7aac0ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:38:20.021775 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=66 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:38:20.050259 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-7ab081d3-1057-47cb-bb0f-809b7aac0ab6 None None] MFA Rules not processed for user `21a7f59ebf1b40a1b76ee2002ae38230`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:38:20.052369 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-7ab081d3-1057-47cb-bb0f-809b7aac0ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:38:20.062527 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 490/976] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Jul 26 15:38:20 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:38:24.135343 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af24a696-4409-4a89-8cf3-0551051a5abe None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:38:24.135875 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af24a696-4409-4a89-8cf3-0551051a5abe None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:38:24.135875 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af24a696-4409-4a89-8cf3-0551051a5abe None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:38:24.137520 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 487/977] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:38:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:38:24.143398 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f73187c-9968-441c-8566-20718abba6e3 None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:38:24.143918 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f73187c-9968-441c-8566-20718abba6e3 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:38:24.144012 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f73187c-9968-441c-8566-20718abba6e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:38:24.171378 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-5f73187c-9968-441c-8566-20718abba6e3 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:38:24.172893 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-5f73187c-9968-441c-8566-20718abba6e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:38:24.182045 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 491/978] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:38:24 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:38:24.248472 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1fb087-69d9-4c5c-a04f-3f4841167f9e None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:38:24.249945 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1fb087-69d9-4c5c-a04f-3f4841167f9e None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:38:24.251054 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1fb087-69d9-4c5c-a04f-3f4841167f9e None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:38:24.254756 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 488/979] 10.222.0.18 () {54 vars in 962 bytes} [Tue Jul 26 15:38:24 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:38:24.263895 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa50097-ff48-4571-b610-85e4c1b11181 None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:38:24.264430 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa50097-ff48-4571-b610-85e4c1b11181 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:38:24.274801 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa50097-ff48-4571-b610-85e4c1b11181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:38:24.332126 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-afa50097-ff48-4571-b610-85e4c1b11181 None None] MFA Rules not processed for user `fbc5f2b36d3f45f1b3c8155e46c46fda`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:38:24.334462 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-afa50097-ff48-4571-b610-85e4c1b11181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:38:24.473106 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 492/980] 10.222.0.18 () {58 vars in 1059 bytes} [Tue Jul 26 15:38:24 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:38:24.488563 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1fb087-69d9-4c5c-a04f-3f4841167f9e None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:38:24.510916 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1fb087-69d9-4c5c-a04f-3f4841167f9e None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:38:24.518451 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be399b77-0eb2-4b41-998c-6d7f14ff9c78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc5f2b36d3f45f1b3c8155e46c46fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9178e468facc41d6a7d828dfcd5301b4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:38:24.519518 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be399b77-0eb2-4b41-998c-6d7f14ff9c78 service nova] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:38:24.519954 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be399b77-0eb2-4b41-998c-6d7f14ff9c78 service nova] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:38:24.520450 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be399b77-0eb2-4b41-998c-6d7f14ff9c78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:38:24.534642 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be399b77-0eb2-4b41-998c-6d7f14ff9c78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:38:24.537262 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be399b77-0eb2-4b41-998c-6d7f14ff9c78 service nova] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:38:24.552318 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 489/981] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 15:38:24 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:38:27.431630 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a3697-c702-4f38-bd8f-af8a55c691a2 None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:38:27.432460 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a3697-c702-4f38-bd8f-af8a55c691a2 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:38:27.432609 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a3697-c702-4f38-bd8f-af8a55c691a2 None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:38:27.435007 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 493/982] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:38:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:38:27.443632 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b7f7ed-19d2-4ad4-ae05-4809c55e2c0b None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:38:27.443632 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b7f7ed-19d2-4ad4-ae05-4809c55e2c0b None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:38:27.444307 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b7f7ed-19d2-4ad4-ae05-4809c55e2c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:38:27.468825 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-00b7f7ed-19d2-4ad4-ae05-4809c55e2c0b None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:38:27.470052 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-00b7f7ed-19d2-4ad4-ae05-4809c55e2c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:38:27.480524 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 490/983] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:38:27 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:38:27.539328 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160a3697-c702-4f38-bd8f-af8a55c691a2 None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:38:27.563083 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160a3697-c702-4f38-bd8f-af8a55c691a2 None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:38:27.571768 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73abaa4a-4971-471c-8871-a14c0d85fdb8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc5f2b36d3f45f1b3c8155e46c46fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9178e468facc41d6a7d828dfcd5301b4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:38:27.573031 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73abaa4a-4971-471c-8871-a14c0d85fdb8 service nova] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:38:27.573574 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73abaa4a-4971-471c-8871-a14c0d85fdb8 service nova] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:38:27.574134 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73abaa4a-4971-471c-8871-a14c0d85fdb8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:38:27.587770 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73abaa4a-4971-471c-8871-a14c0d85fdb8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:38:27.589404 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73abaa4a-4971-471c-8871-a14c0d85fdb8 service nova] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:38:27.605901 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 494/984] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 15:38:27 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:38:30.550706 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43149d-b2c2-43ee-acb2-8ef654d223ca None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:38:30.551372 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43149d-b2c2-43ee-acb2-8ef654d223ca None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:38:30.551372 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43149d-b2c2-43ee-acb2-8ef654d223ca None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:38:30.553416 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 491/985] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:38:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 15:38:30.563221 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca79715b-02b8-4931-92aa-5b33d0581d29 None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:38:30.564083 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca79715b-02b8-4931-92aa-5b33d0581d29 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:38:30.564655 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca79715b-02b8-4931-92aa-5b33d0581d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:38:30.585652 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-ca79715b-02b8-4931-92aa-5b33d0581d29 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:38:30.586879 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-ca79715b-02b8-4931-92aa-5b33d0581d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:38:30.595016 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 495/986] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:38:30 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:38:30.645597 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07334d9-6a0d-4771-9e43-ba8463b01fef None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:38:30.645905 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07334d9-6a0d-4771-9e43-ba8463b01fef None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:38:30.646184 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07334d9-6a0d-4771-9e43-ba8463b01fef None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:38:30.647908 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 492/987] 10.222.0.18 () {54 vars in 962 bytes} [Tue Jul 26 15:38:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:38:30.659092 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56137afb-803b-499e-a803-b1c299497903 None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:38:30.659604 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56137afb-803b-499e-a803-b1c299497903 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:38:30.660165 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56137afb-803b-499e-a803-b1c299497903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:38:30.700713 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-56137afb-803b-499e-a803-b1c299497903 None None] MFA Rules not processed for user `fbc5f2b36d3f45f1b3c8155e46c46fda`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:38:30.701721 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-56137afb-803b-499e-a803-b1c299497903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:38:30.712560 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 496/988] 10.222.0.18 () {58 vars in 1059 bytes} [Tue Jul 26 15:38:30 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:38:30.720775 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07334d9-6a0d-4771-9e43-ba8463b01fef None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:38:30.740819 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07334d9-6a0d-4771-9e43-ba8463b01fef None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:38:30.748874 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f80a890-4688-4bd6-92f9-d56194069fcc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc5f2b36d3f45f1b3c8155e46c46fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9178e468facc41d6a7d828dfcd5301b4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:38:30.749914 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f80a890-4688-4bd6-92f9-d56194069fcc service nova] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:38:30.750413 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f80a890-4688-4bd6-92f9-d56194069fcc service nova] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:38:30.750916 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f80a890-4688-4bd6-92f9-d56194069fcc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:38:30.765668 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f80a890-4688-4bd6-92f9-d56194069fcc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:38:30.768750 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f80a890-4688-4bd6-92f9-d56194069fcc service nova] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:38:30.784144 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 493/989] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 15:38:30 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:38:33.475700 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e5e25-5138-4287-b75b-942e25d854bf None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:38:33.476648 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e5e25-5138-4287-b75b-942e25d854bf None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:38:33.477100 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e5e25-5138-4287-b75b-942e25d854bf None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:38:33.484973 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6864c3-5948-4643-905b-68cc705314f8 None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:38:33.485811 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6864c3-5948-4643-905b-68cc705314f8 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:38:33.486260 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6864c3-5948-4643-905b-68cc705314f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:38:33.490118 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 497/990] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:38:33 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:38:33.509135 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-ea6864c3-5948-4643-905b-68cc705314f8 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:38:33.510798 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-ea6864c3-5948-4643-905b-68cc705314f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:38:33.527537 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 494/991] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:38:33 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:38:33.576520 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7e5e25-5138-4287-b75b-942e25d854bf None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:38:33.593264 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7e5e25-5138-4287-b75b-942e25d854bf None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:38:33.601868 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00219d33-c0b5-49e7-9682-6ae0a65746ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc5f2b36d3f45f1b3c8155e46c46fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9178e468facc41d6a7d828dfcd5301b4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:38:33.602956 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00219d33-c0b5-49e7-9682-6ae0a65746ee service nova] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:38:33.603533 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00219d33-c0b5-49e7-9682-6ae0a65746ee service nova] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:38:33.604280 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00219d33-c0b5-49e7-9682-6ae0a65746ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:38:33.619326 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00219d33-c0b5-49e7-9682-6ae0a65746ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:38:33.622217 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00219d33-c0b5-49e7-9682-6ae0a65746ee service nova] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:38:33.637714 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 498/992] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 15:38:33 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:38:35.665770 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3b18b-ae3a-42f1-8cfe-11b7a17f1b47 None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:38:35.668249 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3b18b-ae3a-42f1-8cfe-11b7a17f1b47 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:38:35.676911 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3b18b-ae3a-42f1-8cfe-11b7a17f1b47 None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:38:35.681637 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 495/993] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:38:35 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:38:35.694152 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ea4c56-1ea5-49e6-bff3-b0747ec9c9c4 None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:38:35.694152 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ea4c56-1ea5-49e6-bff3-b0747ec9c9c4 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:38:35.694152 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ea4c56-1ea5-49e6-bff3-b0747ec9c9c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:38:35.709272 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-04ea4c56-1ea5-49e6-bff3-b0747ec9c9c4 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:38:35.710552 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-04ea4c56-1ea5-49e6-bff3-b0747ec9c9c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:38:35.725944 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 499/994] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:38:35 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:38:36.012388 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce714f6-29d6-482a-86bf-bbfdeca49fe7 None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:38:36.018229 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce714f6-29d6-482a-86bf-bbfdeca49fe7 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:38:36.018229 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce714f6-29d6-482a-86bf-bbfdeca49fe7 None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:38:36.018229 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 496/995] 10.222.0.18 () {54 vars in 964 bytes} [Tue Jul 26 15:38:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:38:36.024372 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b95e19-47d6-4ae4-ab5e-6336056d39ad None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:38:36.024660 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b95e19-47d6-4ae4-ab5e-6336056d39ad None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:38:36.025170 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b95e19-47d6-4ae4-ab5e-6336056d39ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:38:36.086701 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-57b95e19-47d6-4ae4-ab5e-6336056d39ad None None] MFA Rules not processed for user `279031fbf2114c11883018b0d41e243a`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:38:36.087976 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-57b95e19-47d6-4ae4-ab5e-6336056d39ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:38:36.119177 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=100 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:38:36.158282 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 500/996] 10.222.0.18 () {58 vars in 1061 bytes} [Tue Jul 26 15:38:36 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:38:36.166709 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce714f6-29d6-482a-86bf-bbfdeca49fe7 None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:38:36.179565 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce714f6-29d6-482a-86bf-bbfdeca49fe7 None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:38:36.187756 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c66321-1455-4d9e-bac4-b7b0519c9e7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '279031fbf2114c11883018b0d41e243a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9178e468facc41d6a7d828dfcd5301b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:38:36.188538 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c66321-1455-4d9e-bac4-b7b0519c9e7e service cinder] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:38:36.188832 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c66321-1455-4d9e-bac4-b7b0519c9e7e service cinder] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:38:36.189114 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c66321-1455-4d9e-bac4-b7b0519c9e7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:38:36.200165 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c66321-1455-4d9e-bac4-b7b0519c9e7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:38:36.201643 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c66321-1455-4d9e-bac4-b7b0519c9e7e service cinder] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:38:36.212050 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 497/997] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 15:38:36 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:38:36.647671 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d83cbc7-c449-4fb6-be1b-61db618aefba None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:38:36.648332 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d83cbc7-c449-4fb6-be1b-61db618aefba None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:38:36.648671 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d83cbc7-c449-4fb6-be1b-61db618aefba None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:38:36.650194 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 501/998] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:38:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:38:36.655947 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47596400-8e7a-4e7a-bc41-3cfb915d2c30 None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:38:36.656241 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47596400-8e7a-4e7a-bc41-3cfb915d2c30 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:38:36.656702 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47596400-8e7a-4e7a-bc41-3cfb915d2c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:38:36.680612 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-47596400-8e7a-4e7a-bc41-3cfb915d2c30 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:38:36.682049 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-47596400-8e7a-4e7a-bc41-3cfb915d2c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:38:36.692141 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 498/999] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:38:36 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:38:36.744140 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d83cbc7-c449-4fb6-be1b-61db618aefba None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:38:36.760765 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d83cbc7-c449-4fb6-be1b-61db618aefba None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:38:36.766245 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555a4b0e-cbf7-4f5a-b78d-a5068cfd6011 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc5f2b36d3f45f1b3c8155e46c46fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9178e468facc41d6a7d828dfcd5301b4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:38:36.766874 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555a4b0e-cbf7-4f5a-b78d-a5068cfd6011 service nova] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:38:36.767210 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555a4b0e-cbf7-4f5a-b78d-a5068cfd6011 service nova] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:38:36.767538 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555a4b0e-cbf7-4f5a-b78d-a5068cfd6011 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:38:36.778769 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555a4b0e-cbf7-4f5a-b78d-a5068cfd6011 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:38:36.780444 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555a4b0e-cbf7-4f5a-b78d-a5068cfd6011 service nova] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:38:36.792847 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 502/1000] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 15:38:36 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:38:39.676703 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c358c-5b96-4d8c-b685-7ce26e27b6f1 None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:38:39.677521 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c358c-5b96-4d8c-b685-7ce26e27b6f1 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:38:39.677521 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c358c-5b96-4d8c-b685-7ce26e27b6f1 None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:38:39.678930 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 499/1001] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:38:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:38:39.685131 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8749d787-d566-4660-9f16-c10e35aa35e9 None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:38:39.685708 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8749d787-d566-4660-9f16-c10e35aa35e9 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:38:39.685708 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8749d787-d566-4660-9f16-c10e35aa35e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:38:39.708408 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-8749d787-d566-4660-9f16-c10e35aa35e9 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:38:39.709622 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-8749d787-d566-4660-9f16-c10e35aa35e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:38:39.718114 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 503/1002] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:38:39 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:38:39.766107 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7c358c-5b96-4d8c-b685-7ce26e27b6f1 None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:38:39.785570 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7c358c-5b96-4d8c-b685-7ce26e27b6f1 None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:38:39.787381 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6288d774-ea25-4f7c-ae79-0ddada90d3e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc5f2b36d3f45f1b3c8155e46c46fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9178e468facc41d6a7d828dfcd5301b4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:38:39.788289 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288d774-ea25-4f7c-ae79-0ddada90d3e4 service nova] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:38:39.788637 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288d774-ea25-4f7c-ae79-0ddada90d3e4 service nova] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:38:39.788873 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288d774-ea25-4f7c-ae79-0ddada90d3e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:38:39.798368 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6288d774-ea25-4f7c-ae79-0ddada90d3e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:38:39.800230 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6288d774-ea25-4f7c-ae79-0ddada90d3e4 service nova] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:38:39.813831 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 500/1003] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 15:38:39 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:38:42.805943 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c9169-eb6c-4194-b33c-0af980a59024 None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:38:42.806487 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c9169-eb6c-4194-b33c-0af980a59024 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:38:42.806774 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c9169-eb6c-4194-b33c-0af980a59024 None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:38:42.808424 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 504/1004] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:38:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:38:42.814132 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c319391d-f3bf-4419-8284-b6d54d0ca982 None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:38:42.814594 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c319391d-f3bf-4419-8284-b6d54d0ca982 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:38:42.814707 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c319391d-f3bf-4419-8284-b6d54d0ca982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:38:42.835319 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-c319391d-f3bf-4419-8284-b6d54d0ca982 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:38:42.836852 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-c319391d-f3bf-4419-8284-b6d54d0ca982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:38:42.845339 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 501/1005] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:38:42 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:38:42.890910 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731c9169-eb6c-4194-b33c-0af980a59024 None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:38:42.905905 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731c9169-eb6c-4194-b33c-0af980a59024 None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:38:42.911984 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b5b15c-32a1-4cf7-8255-08d865d8263f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc5f2b36d3f45f1b3c8155e46c46fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9178e468facc41d6a7d828dfcd5301b4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:38:42.912701 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5b15c-32a1-4cf7-8255-08d865d8263f service nova] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:38:42.914021 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5b15c-32a1-4cf7-8255-08d865d8263f service nova] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:38:42.914021 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5b15c-32a1-4cf7-8255-08d865d8263f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:38:42.922922 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b5b15c-32a1-4cf7-8255-08d865d8263f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:38:42.924658 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b5b15c-32a1-4cf7-8255-08d865d8263f service nova] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:38:42.940016 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 505/1006] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 15:38:42 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:38:46.050298 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb233df7-3fb7-4994-ad99-bd0b5c10fab7 None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:38:46.051900 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb233df7-3fb7-4994-ad99-bd0b5c10fab7 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:38:46.051900 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb233df7-3fb7-4994-ad99-bd0b5c10fab7 None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:38:46.053073 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 502/1007] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:38:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:38:46.063366 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f3887-56b7-4823-907c-3022b070b67d None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:38:46.063931 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f3887-56b7-4823-907c-3022b070b67d None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:38:46.064286 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f3887-56b7-4823-907c-3022b070b67d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:38:46.093737 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-4f3f3887-56b7-4823-907c-3022b070b67d None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:38:46.095646 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-4f3f3887-56b7-4823-907c-3022b070b67d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:38:46.106902 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 506/1008] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:38:46 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:38:46.162736 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb233df7-3fb7-4994-ad99-bd0b5c10fab7 None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:38:46.181748 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb233df7-3fb7-4994-ad99-bd0b5c10fab7 None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:38:46.188436 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4adb3b7-ddbf-4800-ba93-0cca1ec8fe35 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc5f2b36d3f45f1b3c8155e46c46fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9178e468facc41d6a7d828dfcd5301b4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:38:46.189479 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4adb3b7-ddbf-4800-ba93-0cca1ec8fe35 service nova] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:38:46.189923 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4adb3b7-ddbf-4800-ba93-0cca1ec8fe35 service nova] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:38:46.190354 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4adb3b7-ddbf-4800-ba93-0cca1ec8fe35 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:38:46.201664 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4adb3b7-ddbf-4800-ba93-0cca1ec8fe35 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:38:46.203656 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4adb3b7-ddbf-4800-ba93-0cca1ec8fe35 service nova] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:38:46.223404 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 503/1009] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 15:38:46 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:38:50.016033 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e6097-b397-483c-81e4-421647b92b0a None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:38:50.021032 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e6097-b397-483c-81e4-421647b92b0a None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:38:50.021032 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e6097-b397-483c-81e4-421647b92b0a None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:38:50.021032 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 507/1010] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:38:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:38:50.027054 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce952f-a88b-4252-8362-03f86fb85890 None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:38:50.027769 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce952f-a88b-4252-8362-03f86fb85890 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:38:50.028023 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce952f-a88b-4252-8362-03f86fb85890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:38:50.040733 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=43 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:38:50.062564 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-93ce952f-a88b-4252-8362-03f86fb85890 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:38:50.064399 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-93ce952f-a88b-4252-8362-03f86fb85890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:38:50.078092 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 504/1011] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:38:50 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:38:50.161531 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39e6097-b397-483c-81e4-421647b92b0a None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:38:50.190805 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39e6097-b397-483c-81e4-421647b92b0a None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:38:50.200348 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a576bc-e535-48b1-897d-fa102bb87a4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc5f2b36d3f45f1b3c8155e46c46fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9178e468facc41d6a7d828dfcd5301b4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:38:50.201412 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a576bc-e535-48b1-897d-fa102bb87a4d service nova] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:38:50.201883 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a576bc-e535-48b1-897d-fa102bb87a4d service nova] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:38:50.202396 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a576bc-e535-48b1-897d-fa102bb87a4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:38:50.218426 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a576bc-e535-48b1-897d-fa102bb87a4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:38:50.220890 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a576bc-e535-48b1-897d-fa102bb87a4d service nova] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:38:50.233584 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 508/1012] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 15:38:50 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:38:54.378128 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a9745-29c9-4860-8f88-e6775b521d68 None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:38:54.379282 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a9745-29c9-4860-8f88-e6775b521d68 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:38:54.379282 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a9745-29c9-4860-8f88-e6775b521d68 None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:38:54.381113 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 505/1013] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:38:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:38:54.388080 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a693c2-0a93-48fe-9bc3-d70b77f88c48 None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:38:54.388996 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a693c2-0a93-48fe-9bc3-d70b77f88c48 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:38:54.389298 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a693c2-0a93-48fe-9bc3-d70b77f88c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:38:54.423488 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-21a693c2-0a93-48fe-9bc3-d70b77f88c48 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:38:54.425983 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-21a693c2-0a93-48fe-9bc3-d70b77f88c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:38:54.439653 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 509/1014] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:38:54 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:38:54.490617 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3a9745-29c9-4860-8f88-e6775b521d68 None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:38:54.506430 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3a9745-29c9-4860-8f88-e6775b521d68 None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:38:54.511972 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c8dc3f-d4e5-49ba-9fc2-8548b261f5b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc5f2b36d3f45f1b3c8155e46c46fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9178e468facc41d6a7d828dfcd5301b4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:38:54.512742 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c8dc3f-d4e5-49ba-9fc2-8548b261f5b7 service nova] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:38:54.513129 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c8dc3f-d4e5-49ba-9fc2-8548b261f5b7 service nova] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:38:54.513542 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c8dc3f-d4e5-49ba-9fc2-8548b261f5b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:38:54.524086 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c8dc3f-d4e5-49ba-9fc2-8548b261f5b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:38:54.526384 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c8dc3f-d4e5-49ba-9fc2-8548b261f5b7 service nova] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:38:54.543743 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 506/1015] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 15:38:54 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:38:55.946986 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748e1a2-7b02-4c26-b947-9722372c2c4a None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:38:55.948107 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748e1a2-7b02-4c26-b947-9722372c2c4a None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:38:55.948107 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748e1a2-7b02-4c26-b947-9722372c2c4a None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:38:55.949153 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 510/1016] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:38:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:38:55.955229 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc896924-af6a-4b46-8174-9b4e7b7c65df None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:38:55.955854 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc896924-af6a-4b46-8174-9b4e7b7c65df None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:38:55.955854 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc896924-af6a-4b46-8174-9b4e7b7c65df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:38:55.981610 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-fc896924-af6a-4b46-8174-9b4e7b7c65df None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:38:55.984041 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-fc896924-af6a-4b46-8174-9b4e7b7c65df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:38:55.995440 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 507/1017] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:38:55 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:38:56.062720 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e90020-b1de-4760-9156-bba789f98c6a None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:38:56.063235 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e90020-b1de-4760-9156-bba789f98c6a None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:38:56.063615 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e90020-b1de-4760-9156-bba789f98c6a None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:38:56.066316 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 511/1018] 10.222.0.18 () {54 vars in 966 bytes} [Tue Jul 26 15:38:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:38:56.074954 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c0a917-6959-422e-aed1-090c154a02f8 None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:38:56.075455 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c0a917-6959-422e-aed1-090c154a02f8 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:38:56.075836 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c0a917-6959-422e-aed1-090c154a02f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:38:56.156015 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-26c0a917-6959-422e-aed1-090c154a02f8 None None] MFA Rules not processed for user `d903ca1082154ef2bfac7156d22ddac6`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:38:56.157272 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-26c0a917-6959-422e-aed1-090c154a02f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:38:56.251872 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 508/1019] 10.222.0.18 () {58 vars in 1063 bytes} [Tue Jul 26 15:38:56 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:38:56.261287 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e90020-b1de-4760-9156-bba789f98c6a None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:38:56.278200 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e90020-b1de-4760-9156-bba789f98c6a None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:38:56.283849 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c015aa50-a792-4949-8c5b-20a86438b03c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd903ca1082154ef2bfac7156d22ddac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9178e468facc41d6a7d828dfcd5301b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:38:56.285446 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c015aa50-a792-4949-8c5b-20a86438b03c service glance] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:38:56.285941 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c015aa50-a792-4949-8c5b-20a86438b03c service glance] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:38:56.286516 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c015aa50-a792-4949-8c5b-20a86438b03c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:38:56.303405 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c015aa50-a792-4949-8c5b-20a86438b03c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:38:56.305800 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c015aa50-a792-4949-8c5b-20a86438b03c service glance] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:38:56.321632 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 512/1020] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 15:38:56 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:38:57.293163 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ddb4a5-e8f5-4848-b17d-6677178b46d4 None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:38:57.294138 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ddb4a5-e8f5-4848-b17d-6677178b46d4 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:38:57.294138 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ddb4a5-e8f5-4848-b17d-6677178b46d4 None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:38:57.296389 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 509/1021] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:38:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:38:57.304224 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b78a9f3-d9e8-4a73-bc7a-6d4a56ae3ae5 None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:38:57.305111 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b78a9f3-d9e8-4a73-bc7a-6d4a56ae3ae5 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:38:57.305111 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b78a9f3-d9e8-4a73-bc7a-6d4a56ae3ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:38:57.333902 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-3b78a9f3-d9e8-4a73-bc7a-6d4a56ae3ae5 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:38:57.335612 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-3b78a9f3-d9e8-4a73-bc7a-6d4a56ae3ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:38:57.351334 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 513/1022] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:38:57 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:38:57.402599 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ddb4a5-e8f5-4848-b17d-6677178b46d4 None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:38:57.418761 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ddb4a5-e8f5-4848-b17d-6677178b46d4 None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:38:57.426882 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298eafec-6bf5-4da5-ae4a-9913ad5b58c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc5f2b36d3f45f1b3c8155e46c46fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9178e468facc41d6a7d828dfcd5301b4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:38:57.427687 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298eafec-6bf5-4da5-ae4a-9913ad5b58c9 service nova] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:38:57.428070 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298eafec-6bf5-4da5-ae4a-9913ad5b58c9 service nova] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:38:57.428584 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298eafec-6bf5-4da5-ae4a-9913ad5b58c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:38:57.438458 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298eafec-6bf5-4da5-ae4a-9913ad5b58c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:38:57.441755 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298eafec-6bf5-4da5-ae4a-9913ad5b58c9 service nova] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:38:57.460636 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 510/1023] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 15:38:57 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:39:00.726251 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de987a2f-78c0-4a25-be42-8278cbda5e45 None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:39:00.727208 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de987a2f-78c0-4a25-be42-8278cbda5e45 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:39:00.727208 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de987a2f-78c0-4a25-be42-8278cbda5e45 None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:39:00.728269 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 514/1024] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:39:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:39:00.734843 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7548b26-e061-4103-9ee8-374c1ecd1cc4 None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:39:00.735417 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7548b26-e061-4103-9ee8-374c1ecd1cc4 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:39:00.735791 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7548b26-e061-4103-9ee8-374c1ecd1cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:39:00.776116 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-a7548b26-e061-4103-9ee8-374c1ecd1cc4 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:39:00.777618 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-a7548b26-e061-4103-9ee8-374c1ecd1cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:39:00.789737 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 511/1025] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:39:00 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:39:00.844632 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de987a2f-78c0-4a25-be42-8278cbda5e45 None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:39:00.861992 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de987a2f-78c0-4a25-be42-8278cbda5e45 None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:39:00.868188 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8ac6d4-eb91-4b00-a4a5-f80300e680b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc5f2b36d3f45f1b3c8155e46c46fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9178e468facc41d6a7d828dfcd5301b4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:39:00.868820 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ac6d4-eb91-4b00-a4a5-f80300e680b0 service nova] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:39:00.869105 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ac6d4-eb91-4b00-a4a5-f80300e680b0 service nova] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:39:00.869414 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ac6d4-eb91-4b00-a4a5-f80300e680b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:39:00.883857 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8ac6d4-eb91-4b00-a4a5-f80300e680b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:39:00.883857 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8ac6d4-eb91-4b00-a4a5-f80300e680b0 service nova] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:39:00.892596 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 515/1026] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 15:39:00 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:39:10.768809 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=58 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:39:10.887727 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=55 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:39:16.848393 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c125f895-4717-445d-a9ad-41d1a2160b4d None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:39:16.849228 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c125f895-4717-445d-a9ad-41d1a2160b4d None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:39:16.849228 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c125f895-4717-445d-a9ad-41d1a2160b4d None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:39:16.850329 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 512/1027] 10.222.0.18 () {54 vars in 918 bytes} [Tue Jul 26 15:39:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:39:16.856341 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3585c9b-5140-4abd-bb67-76ebe4527caf None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:39:16.857162 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3585c9b-5140-4abd-bb67-76ebe4527caf None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:39:16.857333 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3585c9b-5140-4abd-bb67-76ebe4527caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:39:16.883421 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-d3585c9b-5140-4abd-bb67-76ebe4527caf None None] MFA Rules not processed for user `21a7f59ebf1b40a1b76ee2002ae38230`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:39:16.885199 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-d3585c9b-5140-4abd-bb67-76ebe4527caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:39:16.896964 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 516/1028] 10.222.0.18 () {58 vars in 1015 bytes} [Tue Jul 26 15:39:16 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:39:16.919283 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6c6f55-6def-4c1b-81d7-72dbe2ebcec3 None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:39:16.919708 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6c6f55-6def-4c1b-81d7-72dbe2ebcec3 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:39:16.920118 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6c6f55-6def-4c1b-81d7-72dbe2ebcec3 None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:39:16.922197 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 513/1029] 10.222.0.18 () {54 vars in 918 bytes} [Tue Jul 26 15:39:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:39:16.930979 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1166b33a-bf4b-4180-8226-4187d53bce28 None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:39:16.931443 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1166b33a-bf4b-4180-8226-4187d53bce28 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:39:16.931855 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1166b33a-bf4b-4180-8226-4187d53bce28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:39:16.954652 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-1166b33a-bf4b-4180-8226-4187d53bce28 None None] MFA Rules not processed for user `fbc5f2b36d3f45f1b3c8155e46c46fda`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:39:16.956227 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-1166b33a-bf4b-4180-8226-4187d53bce28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:39:16.966126 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 517/1030] 10.222.0.18 () {58 vars in 1015 bytes} [Tue Jul 26 15:39:16 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:39:19.966029 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c834532b-0bbe-48e9-aa0d-25b8bc0db07c None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:39:19.966627 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c834532b-0bbe-48e9-aa0d-25b8bc0db07c None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:39:19.967036 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c834532b-0bbe-48e9-aa0d-25b8bc0db07c None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:39:19.969898 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 514/1031] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 15:39:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:39:19.979000 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687d02e-8e85-4d8c-9450-d7c054d0c69c None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:39:19.979605 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687d02e-8e85-4d8c-9450-d7c054d0c69c None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:39:19.980057 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687d02e-8e85-4d8c-9450-d7c054d0c69c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:39:20.012070 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-4687d02e-8e85-4d8c-9450-d7c054d0c69c None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:39:20.013289 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-4687d02e-8e85-4d8c-9450-d7c054d0c69c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:39:20.021749 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 518/1032] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 15:39:19 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:39:20.082462 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c834532b-0bbe-48e9-aa0d-25b8bc0db07c None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:39:20.098255 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c834532b-0bbe-48e9-aa0d-25b8bc0db07c None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:39:20.103588 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9860af99-9214-4f1a-bb81-4e56a680870d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc5f2b36d3f45f1b3c8155e46c46fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9178e468facc41d6a7d828dfcd5301b4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:39:20.104205 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9860af99-9214-4f1a-bb81-4e56a680870d service nova] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:39:20.104484 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9860af99-9214-4f1a-bb81-4e56a680870d service nova] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:39:20.104761 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9860af99-9214-4f1a-bb81-4e56a680870d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:39:20.114768 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9860af99-9214-4f1a-bb81-4e56a680870d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:39:20.116448 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9860af99-9214-4f1a-bb81-4e56a680870d service nova] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:39:20.127357 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 515/1033] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 15:39:20 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:39:21.125468 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ebf84d-c644-4e62-933f-799f53750840 None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:39:21.126025 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ebf84d-c644-4e62-933f-799f53750840 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:39:21.126364 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ebf84d-c644-4e62-933f-799f53750840 None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:39:21.128898 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 519/1034] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 15:39:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:39:21.134302 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acdcef1-f5fc-4603-a966-48d60be12fd4 None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:39:21.134810 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acdcef1-f5fc-4603-a966-48d60be12fd4 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:39:21.134919 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acdcef1-f5fc-4603-a966-48d60be12fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:39:21.154763 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-5acdcef1-f5fc-4603-a966-48d60be12fd4 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:39:21.156028 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-5acdcef1-f5fc-4603-a966-48d60be12fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:39:21.164273 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 516/1035] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 15:39:21 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:39:21.400485 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ebf84d-c644-4e62-933f-799f53750840 None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:39:21.415855 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ebf84d-c644-4e62-933f-799f53750840 None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:39:21.421025 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21ad1ea-3fcc-4877-a041-279f60fccbc0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc5f2b36d3f45f1b3c8155e46c46fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9178e468facc41d6a7d828dfcd5301b4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:39:21.421666 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ad1ea-3fcc-4877-a041-279f60fccbc0 service nova] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:39:21.421953 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ad1ea-3fcc-4877-a041-279f60fccbc0 service nova] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:39:21.422233 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ad1ea-3fcc-4877-a041-279f60fccbc0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:39:21.432434 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21ad1ea-3fcc-4877-a041-279f60fccbc0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:39:21.434130 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21ad1ea-3fcc-4877-a041-279f60fccbc0 service nova] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:39:21.444965 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 520/1036] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 15:39:21 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:39:22.390336 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e796fa59-9e57-493b-b497-95ed391d8cb8 None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:39:22.391067 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e796fa59-9e57-493b-b497-95ed391d8cb8 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:39:22.391067 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e796fa59-9e57-493b-b497-95ed391d8cb8 None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:39:22.392285 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 517/1037] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 15:39:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 15:39:22.398609 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff331c-ded1-4620-bf22-02c5cc335922 None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:39:22.399191 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff331c-ded1-4620-bf22-02c5cc335922 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:39:22.399191 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff331c-ded1-4620-bf22-02c5cc335922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:39:22.421405 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-86ff331c-ded1-4620-bf22-02c5cc335922 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:39:22.422652 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-86ff331c-ded1-4620-bf22-02c5cc335922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:39:22.430625 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 521/1038] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 15:39:22 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:39:22.587708 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e796fa59-9e57-493b-b497-95ed391d8cb8 None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:39:22.601277 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e796fa59-9e57-493b-b497-95ed391d8cb8 None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:39:22.606275 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac119b37-4dfe-406e-b18f-bb4203b4a4b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc5f2b36d3f45f1b3c8155e46c46fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9178e468facc41d6a7d828dfcd5301b4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:39:22.606899 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac119b37-4dfe-406e-b18f-bb4203b4a4b3 service nova] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:39:22.607217 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac119b37-4dfe-406e-b18f-bb4203b4a4b3 service nova] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:39:22.607493 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac119b37-4dfe-406e-b18f-bb4203b4a4b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:39:22.617047 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac119b37-4dfe-406e-b18f-bb4203b4a4b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:39:22.618676 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac119b37-4dfe-406e-b18f-bb4203b4a4b3 service nova] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:39:22.629506 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 518/1039] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 15:39:22 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:39:23.607290 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb35f4d-7435-4be3-8740-b02d4a7a36b7 None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:39:23.608160 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb35f4d-7435-4be3-8740-b02d4a7a36b7 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:39:23.608160 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb35f4d-7435-4be3-8740-b02d4a7a36b7 None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:39:23.609303 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 522/1040] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 15:39:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 15:39:23.616065 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f38ded-fdef-4ec1-bf68-8a827eaaad21 None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:39:23.616654 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f38ded-fdef-4ec1-bf68-8a827eaaad21 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:39:23.616960 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f38ded-fdef-4ec1-bf68-8a827eaaad21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:39:23.640381 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-59f38ded-fdef-4ec1-bf68-8a827eaaad21 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:39:23.641817 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-59f38ded-fdef-4ec1-bf68-8a827eaaad21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:39:23.656223 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 519/1041] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 15:39:23 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:39:23.913203 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb35f4d-7435-4be3-8740-b02d4a7a36b7 None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:39:23.929806 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb35f4d-7435-4be3-8740-b02d4a7a36b7 None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:39:23.935413 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77e02fe-b8b9-4133-b07c-963aa4ce5fdf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc5f2b36d3f45f1b3c8155e46c46fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9178e468facc41d6a7d828dfcd5301b4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:39:23.936242 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77e02fe-b8b9-4133-b07c-963aa4ce5fdf service nova] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:39:23.936576 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77e02fe-b8b9-4133-b07c-963aa4ce5fdf service nova] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:39:23.936896 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77e02fe-b8b9-4133-b07c-963aa4ce5fdf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:39:23.946207 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77e02fe-b8b9-4133-b07c-963aa4ce5fdf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:39:23.949274 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77e02fe-b8b9-4133-b07c-963aa4ce5fdf service nova] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:39:23.959223 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 523/1042] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 15:39:23 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:39:24.860873 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f72941-1887-4afe-bbe5-f467085d2860 None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:39:24.861484 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f72941-1887-4afe-bbe5-f467085d2860 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:39:24.861484 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f72941-1887-4afe-bbe5-f467085d2860 None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:39:24.862892 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 520/1043] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 15:39:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:39:24.868332 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af4561-b903-4d2c-af1d-89698620a95e None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:39:24.868817 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af4561-b903-4d2c-af1d-89698620a95e None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:39:24.868982 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af4561-b903-4d2c-af1d-89698620a95e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:39:24.889299 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-04af4561-b903-4d2c-af1d-89698620a95e None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:39:24.890592 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-04af4561-b903-4d2c-af1d-89698620a95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:39:24.899090 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 524/1044] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 15:39:24 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:39:25.056139 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f72941-1887-4afe-bbe5-f467085d2860 None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:39:25.070115 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f72941-1887-4afe-bbe5-f467085d2860 None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:39:25.075076 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4956b8b3-db4c-4b09-9576-3b03d8a69159 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc5f2b36d3f45f1b3c8155e46c46fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9178e468facc41d6a7d828dfcd5301b4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:39:25.075725 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4956b8b3-db4c-4b09-9576-3b03d8a69159 service nova] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:39:25.076007 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4956b8b3-db4c-4b09-9576-3b03d8a69159 service nova] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:39:25.076284 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4956b8b3-db4c-4b09-9576-3b03d8a69159 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:39:25.085391 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4956b8b3-db4c-4b09-9576-3b03d8a69159 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:39:25.087023 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4956b8b3-db4c-4b09-9576-3b03d8a69159 service nova] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:39:25.098136 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 521/1045] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 15:39:25 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:39:26.026316 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2f212a-1e70-49e6-b10e-3a4cef747edd None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:39:26.027177 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2f212a-1e70-49e6-b10e-3a4cef747edd None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:39:26.027177 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2f212a-1e70-49e6-b10e-3a4cef747edd None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:39:26.028272 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 525/1046] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 15:39:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:39:26.034555 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf026f9-fb25-4b0c-8a2d-004e6ddde3c4 None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:39:26.035161 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf026f9-fb25-4b0c-8a2d-004e6ddde3c4 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:39:26.035485 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf026f9-fb25-4b0c-8a2d-004e6ddde3c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:39:26.056477 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-1bf026f9-fb25-4b0c-8a2d-004e6ddde3c4 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:39:26.057704 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-1bf026f9-fb25-4b0c-8a2d-004e6ddde3c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:39:26.065751 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 522/1047] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 15:39:26 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:39:26.223296 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2f212a-1e70-49e6-b10e-3a4cef747edd None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:39:26.242141 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2f212a-1e70-49e6-b10e-3a4cef747edd None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:39:26.247578 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daa084b-8c60-4ad6-9a24-a9ec55329cba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc5f2b36d3f45f1b3c8155e46c46fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9178e468facc41d6a7d828dfcd5301b4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:39:26.248216 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa084b-8c60-4ad6-9a24-a9ec55329cba service nova] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:39:26.248503 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa084b-8c60-4ad6-9a24-a9ec55329cba service nova] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:39:26.248780 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa084b-8c60-4ad6-9a24-a9ec55329cba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:39:26.258268 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daa084b-8c60-4ad6-9a24-a9ec55329cba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:39:26.259925 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daa084b-8c60-4ad6-9a24-a9ec55329cba service nova] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:39:26.272319 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 526/1048] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 15:39:26 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:39:27.164447 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc45e080-e78d-4c65-afb0-2afe7ef0b30b None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:39:27.164973 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc45e080-e78d-4c65-afb0-2afe7ef0b30b None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:39:27.164973 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc45e080-e78d-4c65-afb0-2afe7ef0b30b None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:39:27.166288 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 523/1049] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 15:39:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:39:27.171481 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a69a2ac-d4ed-4110-a915-0e14791ae51c None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:39:27.171925 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a69a2ac-d4ed-4110-a915-0e14791ae51c None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:39:27.172090 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a69a2ac-d4ed-4110-a915-0e14791ae51c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:39:27.193288 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-5a69a2ac-d4ed-4110-a915-0e14791ae51c None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:39:27.194652 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-5a69a2ac-d4ed-4110-a915-0e14791ae51c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:39:27.202745 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 527/1050] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 15:39:27 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:39:27.363476 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc45e080-e78d-4c65-afb0-2afe7ef0b30b None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:39:27.379193 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc45e080-e78d-4c65-afb0-2afe7ef0b30b None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:39:27.384557 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18db595-e47a-4cde-ab7c-3fff2314e710 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc5f2b36d3f45f1b3c8155e46c46fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9178e468facc41d6a7d828dfcd5301b4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:39:27.385189 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18db595-e47a-4cde-ab7c-3fff2314e710 service nova] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:39:27.385468 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18db595-e47a-4cde-ab7c-3fff2314e710 service nova] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:39:27.385740 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18db595-e47a-4cde-ab7c-3fff2314e710 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:39:27.395284 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18db595-e47a-4cde-ab7c-3fff2314e710 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:39:27.396928 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18db595-e47a-4cde-ab7c-3fff2314e710 service nova] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:39:27.409994 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 524/1051] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 15:39:27 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:39:28.329286 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e04aa-0508-4f8c-b0a0-60bc4c5421ea None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:39:28.330998 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e04aa-0508-4f8c-b0a0-60bc4c5421ea None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:39:28.330998 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e04aa-0508-4f8c-b0a0-60bc4c5421ea None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:39:28.331953 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 528/1052] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 15:39:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:39:28.341994 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f081c4-304a-472c-a74f-7bcfe1fddc69 None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:39:28.348404 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f081c4-304a-472c-a74f-7bcfe1fddc69 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:39:28.348404 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f081c4-304a-472c-a74f-7bcfe1fddc69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:39:28.368609 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-11f081c4-304a-472c-a74f-7bcfe1fddc69 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:39:28.369862 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-11f081c4-304a-472c-a74f-7bcfe1fddc69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:39:28.378748 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 525/1053] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 15:39:28 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:39:28.548203 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e04aa-0508-4f8c-b0a0-60bc4c5421ea None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:39:28.562581 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e04aa-0508-4f8c-b0a0-60bc4c5421ea None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:39:28.568518 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394d33d4-e569-4132-930c-2db9b9814a12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc5f2b36d3f45f1b3c8155e46c46fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9178e468facc41d6a7d828dfcd5301b4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:39:28.569118 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394d33d4-e569-4132-930c-2db9b9814a12 service nova] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:39:28.569401 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394d33d4-e569-4132-930c-2db9b9814a12 service nova] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:39:28.569681 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394d33d4-e569-4132-930c-2db9b9814a12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:39:28.578953 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394d33d4-e569-4132-930c-2db9b9814a12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:39:28.581244 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394d33d4-e569-4132-930c-2db9b9814a12 service nova] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:39:28.592034 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 529/1054] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 15:39:28 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:39:29.489167 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ceb6d-e60f-4c76-9850-f8c8c06139f1 None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:39:29.489713 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ceb6d-e60f-4c76-9850-f8c8c06139f1 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:39:29.489833 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ceb6d-e60f-4c76-9850-f8c8c06139f1 None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:39:29.491377 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 526/1055] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 15:39:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:39:29.497692 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd9419e-1fd3-4990-ba90-e1312c085afb None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:39:29.498253 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd9419e-1fd3-4990-ba90-e1312c085afb None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:39:29.498375 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd9419e-1fd3-4990-ba90-e1312c085afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:39:29.521268 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-fcd9419e-1fd3-4990-ba90-e1312c085afb None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:39:29.522705 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-fcd9419e-1fd3-4990-ba90-e1312c085afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:39:29.532308 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 530/1056] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 15:39:29 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:39:29.692072 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6ceb6d-e60f-4c76-9850-f8c8c06139f1 None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:39:29.706946 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6ceb6d-e60f-4c76-9850-f8c8c06139f1 None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:39:29.712462 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495eed12-0301-42da-9d59-ca3705172979 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc5f2b36d3f45f1b3c8155e46c46fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9178e468facc41d6a7d828dfcd5301b4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:39:29.713092 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495eed12-0301-42da-9d59-ca3705172979 service nova] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:39:29.713375 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495eed12-0301-42da-9d59-ca3705172979 service nova] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:39:29.713669 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495eed12-0301-42da-9d59-ca3705172979 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:39:29.723741 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495eed12-0301-42da-9d59-ca3705172979 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:39:29.725454 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495eed12-0301-42da-9d59-ca3705172979 service nova] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:39:29.737249 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 527/1057] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 15:39:29 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:39:31.929655 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce466d3-6137-4d77-9a92-2a8bf040187c None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:39:31.930379 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce466d3-6137-4d77-9a92-2a8bf040187c None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:39:31.930616 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce466d3-6137-4d77-9a92-2a8bf040187c None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:39:31.933182 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 531/1058] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 15:39:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:39:31.941806 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e3df35-a1da-4030-97af-47df44cb02fd None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:39:31.942306 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e3df35-a1da-4030-97af-47df44cb02fd None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:39:31.942402 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e3df35-a1da-4030-97af-47df44cb02fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:39:31.962844 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-f5e3df35-a1da-4030-97af-47df44cb02fd None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:39:31.964361 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-f5e3df35-a1da-4030-97af-47df44cb02fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:39:31.973514 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 528/1059] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 15:39:31 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:39:32.015981 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce466d3-6137-4d77-9a92-2a8bf040187c None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:39:32.027347 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce466d3-6137-4d77-9a92-2a8bf040187c None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:39:32.030881 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bdfaf1-a916-48e9-b30e-5d33820c7ae8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960c230d1e8841e6b231fdbf4d172cc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9178e468facc41d6a7d828dfcd5301b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:39:32.031532 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bdfaf1-a916-48e9-b30e-5d33820c7ae8 service neutron] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:39:32.031816 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bdfaf1-a916-48e9-b30e-5d33820c7ae8 service neutron] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:39:32.032096 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bdfaf1-a916-48e9-b30e-5d33820c7ae8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:39:32.042540 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bdfaf1-a916-48e9-b30e-5d33820c7ae8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:39:32.044256 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bdfaf1-a916-48e9-b30e-5d33820c7ae8 service neutron] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:39:32.055434 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 532/1060] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 15:39:32 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:39:34.526810 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abec3fea-3ba0-4219-9cc1-4051d4a8a267 None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:39:34.527428 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abec3fea-3ba0-4219-9cc1-4051d4a8a267 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:39:34.527428 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abec3fea-3ba0-4219-9cc1-4051d4a8a267 None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:39:34.528764 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 529/1061] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 15:39:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 15:39:34.536028 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ffec5-5f89-4174-9aac-e95b0bd0eb00 None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:39:34.536529 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ffec5-5f89-4174-9aac-e95b0bd0eb00 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:39:34.543303 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ffec5-5f89-4174-9aac-e95b0bd0eb00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:39:34.559283 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-a47ffec5-5f89-4174-9aac-e95b0bd0eb00 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:39:34.561097 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-a47ffec5-5f89-4174-9aac-e95b0bd0eb00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:39:34.571772 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 533/1062] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 15:39:34 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:39:34.611538 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abec3fea-3ba0-4219-9cc1-4051d4a8a267 None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:39:34.622539 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abec3fea-3ba0-4219-9cc1-4051d4a8a267 None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:39:34.626084 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4f1c83-415f-48c9-82e8-1665438f7249 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960c230d1e8841e6b231fdbf4d172cc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9178e468facc41d6a7d828dfcd5301b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:39:34.626697 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4f1c83-415f-48c9-82e8-1665438f7249 service neutron] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:39:34.626982 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4f1c83-415f-48c9-82e8-1665438f7249 service neutron] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:39:34.627298 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4f1c83-415f-48c9-82e8-1665438f7249 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:39:34.636797 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4f1c83-415f-48c9-82e8-1665438f7249 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:39:34.638262 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4f1c83-415f-48c9-82e8-1665438f7249 service neutron] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:39:34.648801 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 530/1063] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 15:39:34 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:39:37.541338 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7384db08-df1e-4657-bb7a-8da45ea2e024 None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:39:37.541906 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7384db08-df1e-4657-bb7a-8da45ea2e024 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:39:37.541906 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7384db08-df1e-4657-bb7a-8da45ea2e024 None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:39:37.543308 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 534/1064] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 15:39:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:39:37.548870 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa2425a-3f7e-4806-b168-68e3319af152 None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:39:37.549334 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa2425a-3f7e-4806-b168-68e3319af152 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:39:37.549579 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa2425a-3f7e-4806-b168-68e3319af152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:39:37.569669 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-aaa2425a-3f7e-4806-b168-68e3319af152 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:39:37.570935 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-aaa2425a-3f7e-4806-b168-68e3319af152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:39:37.579317 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 531/1065] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 15:39:37 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:39:37.620193 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7384db08-df1e-4657-bb7a-8da45ea2e024 None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:39:37.631161 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7384db08-df1e-4657-bb7a-8da45ea2e024 None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:39:37.634677 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed8b5fa-9954-41a9-8112-18681e7671c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960c230d1e8841e6b231fdbf4d172cc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9178e468facc41d6a7d828dfcd5301b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:39:37.635406 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8b5fa-9954-41a9-8112-18681e7671c5 service neutron] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:39:37.635603 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8b5fa-9954-41a9-8112-18681e7671c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:39:37.635877 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8b5fa-9954-41a9-8112-18681e7671c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:39:37.646025 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed8b5fa-9954-41a9-8112-18681e7671c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:39:37.647524 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed8b5fa-9954-41a9-8112-18681e7671c5 service neutron] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:39:37.656987 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 535/1066] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 15:39:37 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:39:40.111933 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88a3646-ec61-4ca9-a5d2-44ccd39277aa None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:39:40.112571 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88a3646-ec61-4ca9-a5d2-44ccd39277aa None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:39:40.112571 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88a3646-ec61-4ca9-a5d2-44ccd39277aa None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:39:40.113887 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 532/1067] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 15:39:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 15:39:40.119442 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead87f5b-0531-483e-9b1b-ab1e9fbd5903 None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:39:40.119893 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead87f5b-0531-483e-9b1b-ab1e9fbd5903 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:39:40.119989 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead87f5b-0531-483e-9b1b-ab1e9fbd5903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:39:40.139725 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-ead87f5b-0531-483e-9b1b-ab1e9fbd5903 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:39:40.140942 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-ead87f5b-0531-483e-9b1b-ab1e9fbd5903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:39:40.148832 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 536/1068] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 15:39:40 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:39:40.189871 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88a3646-ec61-4ca9-a5d2-44ccd39277aa None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:39:40.200642 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88a3646-ec61-4ca9-a5d2-44ccd39277aa None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:39:40.204169 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76472a26-1a29-4d06-907f-dd142e6f7d11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960c230d1e8841e6b231fdbf4d172cc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9178e468facc41d6a7d828dfcd5301b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:39:40.204804 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76472a26-1a29-4d06-907f-dd142e6f7d11 service neutron] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:39:40.205086 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76472a26-1a29-4d06-907f-dd142e6f7d11 service neutron] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:39:40.205364 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76472a26-1a29-4d06-907f-dd142e6f7d11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:39:40.214780 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76472a26-1a29-4d06-907f-dd142e6f7d11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:39:40.216310 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76472a26-1a29-4d06-907f-dd142e6f7d11 service neutron] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:39:40.226472 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 533/1069] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 15:39:40 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:39:42.537180 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd069805-f8b1-456f-94e4-cbd9f3882404 None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:39:42.538035 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd069805-f8b1-456f-94e4-cbd9f3882404 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:39:42.538035 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd069805-f8b1-456f-94e4-cbd9f3882404 None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:39:42.539703 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 537/1070] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 15:39:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:39:42.545630 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67174338-0cc5-4c2d-881d-1b2d8742222b None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:39:42.546173 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67174338-0cc5-4c2d-881d-1b2d8742222b None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:39:42.546173 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67174338-0cc5-4c2d-881d-1b2d8742222b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:39:42.553956 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=61 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:39:42.568645 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-67174338-0cc5-4c2d-881d-1b2d8742222b None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:39:42.569896 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-67174338-0cc5-4c2d-881d-1b2d8742222b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:39:42.578023 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 534/1071] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 15:39:42 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:39:42.618376 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd069805-f8b1-456f-94e4-cbd9f3882404 None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:39:42.624037 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=64 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:39:42.630698 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd069805-f8b1-456f-94e4-cbd9f3882404 None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:39:42.637043 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc530b68-9c31-406f-8ce1-30352175a14d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960c230d1e8841e6b231fdbf4d172cc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9178e468facc41d6a7d828dfcd5301b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:39:42.637043 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc530b68-9c31-406f-8ce1-30352175a14d service neutron] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:39:42.637043 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc530b68-9c31-406f-8ce1-30352175a14d service neutron] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:39:42.637043 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc530b68-9c31-406f-8ce1-30352175a14d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:39:42.646167 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc530b68-9c31-406f-8ce1-30352175a14d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:39:42.647785 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc530b68-9c31-406f-8ce1-30352175a14d service neutron] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:39:42.658772 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 538/1072] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 15:39:42 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:39:45.001997 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b757e8-f51b-451e-9513-c03a8967c3be None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:39:45.002538 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b757e8-f51b-451e-9513-c03a8967c3be None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:39:45.002538 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b757e8-f51b-451e-9513-c03a8967c3be None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:39:45.003977 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 535/1073] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 15:39:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:39:45.009812 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed7be7-3f9c-4a31-8c3b-811af5f3aa41 None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:39:45.010339 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed7be7-3f9c-4a31-8c3b-811af5f3aa41 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:39:45.010339 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed7be7-3f9c-4a31-8c3b-811af5f3aa41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:39:45.031246 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-beed7be7-3f9c-4a31-8c3b-811af5f3aa41 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:39:45.032539 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-beed7be7-3f9c-4a31-8c3b-811af5f3aa41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:39:45.041581 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 539/1074] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 15:39:45 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:39:45.082099 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b757e8-f51b-451e-9513-c03a8967c3be None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:39:45.093087 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b757e8-f51b-451e-9513-c03a8967c3be None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:39:45.097225 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a8b540-93d5-4471-92ef-a17f23f3bf55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960c230d1e8841e6b231fdbf4d172cc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9178e468facc41d6a7d828dfcd5301b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:39:45.097835 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a8b540-93d5-4471-92ef-a17f23f3bf55 service neutron] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:39:45.098115 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a8b540-93d5-4471-92ef-a17f23f3bf55 service neutron] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:39:45.098388 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a8b540-93d5-4471-92ef-a17f23f3bf55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:39:45.107433 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a8b540-93d5-4471-92ef-a17f23f3bf55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:39:45.108892 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a8b540-93d5-4471-92ef-a17f23f3bf55 service neutron] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:39:45.118230 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 536/1075] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 15:39:45 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:39:47.523836 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0586029-5851-4ebf-a6c4-77d944917c3b None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:39:47.524479 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0586029-5851-4ebf-a6c4-77d944917c3b None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:39:47.524479 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0586029-5851-4ebf-a6c4-77d944917c3b None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:39:47.525787 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 540/1076] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 15:39:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 15:39:47.531806 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b18f5-e12b-4a41-9cee-761eaef725a4 None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:39:47.532664 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b18f5-e12b-4a41-9cee-761eaef725a4 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:39:47.532664 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b18f5-e12b-4a41-9cee-761eaef725a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:39:47.552753 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-662b18f5-e12b-4a41-9cee-761eaef725a4 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:39:47.553995 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-662b18f5-e12b-4a41-9cee-761eaef725a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:39:47.562263 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 537/1077] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 15:39:47 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:39:47.604133 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0586029-5851-4ebf-a6c4-77d944917c3b None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:39:47.617643 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0586029-5851-4ebf-a6c4-77d944917c3b None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:39:47.621354 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab3f510-011b-4162-a9a3-8710bac1d83d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960c230d1e8841e6b231fdbf4d172cc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9178e468facc41d6a7d828dfcd5301b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:39:47.621995 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab3f510-011b-4162-a9a3-8710bac1d83d service neutron] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:39:47.622276 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab3f510-011b-4162-a9a3-8710bac1d83d service neutron] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:39:47.622553 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab3f510-011b-4162-a9a3-8710bac1d83d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:39:47.633320 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab3f510-011b-4162-a9a3-8710bac1d83d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:39:47.635413 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab3f510-011b-4162-a9a3-8710bac1d83d service neutron] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:39:47.646102 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 541/1078] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 15:39:47 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:39:49.990786 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc227cd-3d7a-4bc9-813d-4daa201448aa None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:39:49.991456 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc227cd-3d7a-4bc9-813d-4daa201448aa None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:39:49.991774 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc227cd-3d7a-4bc9-813d-4daa201448aa None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:39:49.994376 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 538/1079] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 15:39:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 15:39:50.004655 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c9ca5-20f1-4223-b9c1-29242db4587e None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:39:50.005231 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c9ca5-20f1-4223-b9c1-29242db4587e None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:39:50.005684 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c9ca5-20f1-4223-b9c1-29242db4587e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:39:50.037127 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-205c9ca5-20f1-4223-b9c1-29242db4587e None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:39:50.039045 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-205c9ca5-20f1-4223-b9c1-29242db4587e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:39:50.048062 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 542/1080] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 15:39:50 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:39:50.088621 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc227cd-3d7a-4bc9-813d-4daa201448aa None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:39:50.106667 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc227cd-3d7a-4bc9-813d-4daa201448aa None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:39:50.110256 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b3163d-f0ea-448d-9755-ce2b2af2f00a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960c230d1e8841e6b231fdbf4d172cc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9178e468facc41d6a7d828dfcd5301b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:39:50.111681 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b3163d-f0ea-448d-9755-ce2b2af2f00a service neutron] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:39:50.111956 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b3163d-f0ea-448d-9755-ce2b2af2f00a service neutron] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:39:50.112227 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b3163d-f0ea-448d-9755-ce2b2af2f00a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:39:50.122534 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b3163d-f0ea-448d-9755-ce2b2af2f00a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:39:50.124142 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b3163d-f0ea-448d-9755-ce2b2af2f00a service neutron] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:39:50.134511 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 539/1081] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 15:39:50 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:39:52.523152 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c671a-1239-435e-8ef1-5ebe79268eb2 None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:39:52.523718 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c671a-1239-435e-8ef1-5ebe79268eb2 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:39:52.524145 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c671a-1239-435e-8ef1-5ebe79268eb2 None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:39:52.526471 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 543/1082] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 15:39:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:39:52.533170 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1be76b-279e-4238-b721-ecf694745cdc None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:39:52.533727 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1be76b-279e-4238-b721-ecf694745cdc None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:39:52.533727 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1be76b-279e-4238-b721-ecf694745cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:39:52.553923 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-7b1be76b-279e-4238-b721-ecf694745cdc None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:39:52.555168 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-7b1be76b-279e-4238-b721-ecf694745cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:39:52.563365 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 540/1083] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 15:39:52 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:39:52.602667 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82c671a-1239-435e-8ef1-5ebe79268eb2 None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:39:52.613699 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82c671a-1239-435e-8ef1-5ebe79268eb2 None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:39:52.617307 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733f1f43-7614-4eb6-8393-b8403e76eb7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960c230d1e8841e6b231fdbf4d172cc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9178e468facc41d6a7d828dfcd5301b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:39:52.617953 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f1f43-7614-4eb6-8393-b8403e76eb7d service neutron] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:39:52.618240 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f1f43-7614-4eb6-8393-b8403e76eb7d service neutron] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:39:52.618517 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f1f43-7614-4eb6-8393-b8403e76eb7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:39:52.629197 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733f1f43-7614-4eb6-8393-b8403e76eb7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:39:52.630894 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733f1f43-7614-4eb6-8393-b8403e76eb7d service neutron] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:39:52.642757 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 544/1084] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 15:39:52 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:39:54.948932 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9fe3ec-29ab-49dd-9d99-e2446573be36 None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:39:54.949488 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9fe3ec-29ab-49dd-9d99-e2446573be36 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:39:54.949488 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9fe3ec-29ab-49dd-9d99-e2446573be36 None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:39:54.950867 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 541/1085] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 15:39:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 15:39:54.957700 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0009fbe4-03be-4cd0-8ebb-0a89843fa6c2 None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:39:54.965711 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0009fbe4-03be-4cd0-8ebb-0a89843fa6c2 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:39:54.965711 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0009fbe4-03be-4cd0-8ebb-0a89843fa6c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:39:54.983472 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-0009fbe4-03be-4cd0-8ebb-0a89843fa6c2 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:39:54.986295 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-0009fbe4-03be-4cd0-8ebb-0a89843fa6c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:39:55.000587 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 545/1086] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 15:39:54 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:39:55.048895 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9fe3ec-29ab-49dd-9d99-e2446573be36 None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:39:55.060142 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9fe3ec-29ab-49dd-9d99-e2446573be36 None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:39:55.063758 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24966746-6448-41d4-bd90-ab2030502832 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960c230d1e8841e6b231fdbf4d172cc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9178e468facc41d6a7d828dfcd5301b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:39:55.064911 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24966746-6448-41d4-bd90-ab2030502832 service neutron] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:39:55.065194 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24966746-6448-41d4-bd90-ab2030502832 service neutron] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:39:55.065468 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24966746-6448-41d4-bd90-ab2030502832 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:39:55.075392 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24966746-6448-41d4-bd90-ab2030502832 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:39:55.076868 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24966746-6448-41d4-bd90-ab2030502832 service neutron] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:39:55.086986 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 542/1087] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 15:39:55 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:40:04.975808 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=26 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:40:05.082610 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=26 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:40:19.401073 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87792dce-1276-41af-8227-699553d1898f None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:40:19.401776 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87792dce-1276-41af-8227-699553d1898f None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:40:19.401776 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87792dce-1276-41af-8227-699553d1898f None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:40:19.403179 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 546/1088] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:40:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:40:19.409189 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e459114-e815-4235-914d-104031ab79f3 None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:40:19.409695 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e459114-e815-4235-914d-104031ab79f3 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:40:19.409798 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e459114-e815-4235-914d-104031ab79f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:40:19.429246 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-8e459114-e815-4235-914d-104031ab79f3 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:40:19.430463 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-8e459114-e815-4235-914d-104031ab79f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:40:19.439470 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 543/1089] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:40:19 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:40:19.491003 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de67b0d3-f6f1-441a-bfdc-571e8a3a4d28 None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:40:19.491331 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de67b0d3-f6f1-441a-bfdc-571e8a3a4d28 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:40:19.491618 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de67b0d3-f6f1-441a-bfdc-571e8a3a4d28 None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:40:19.492966 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 547/1090] 10.222.0.18 () {54 vars in 966 bytes} [Tue Jul 26 15:40:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:40:19.498542 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d77ad68-45d5-49dc-b220-9807a8601dde None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:40:19.498837 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d77ad68-45d5-49dc-b220-9807a8601dde None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:40:19.499120 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d77ad68-45d5-49dc-b220-9807a8601dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:40:19.520618 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-3d77ad68-45d5-49dc-b220-9807a8601dde None None] MFA Rules not processed for user `d903ca1082154ef2bfac7156d22ddac6`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:40:19.521843 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-3d77ad68-45d5-49dc-b220-9807a8601dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:40:19.528590 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 544/1091] 10.222.0.18 () {58 vars in 1063 bytes} [Tue Jul 26 15:40:19 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:40:19.542761 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de67b0d3-f6f1-441a-bfdc-571e8a3a4d28 None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:40:19.553990 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de67b0d3-f6f1-441a-bfdc-571e8a3a4d28 None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:40:19.557637 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9956e0a3-dce9-477d-9b9e-3ff3dcade69b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd903ca1082154ef2bfac7156d22ddac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9178e468facc41d6a7d828dfcd5301b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:40:19.558303 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9956e0a3-dce9-477d-9b9e-3ff3dcade69b service glance] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:40:19.558591 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9956e0a3-dce9-477d-9b9e-3ff3dcade69b service glance] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:40:19.558981 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9956e0a3-dce9-477d-9b9e-3ff3dcade69b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:40:19.568714 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9956e0a3-dce9-477d-9b9e-3ff3dcade69b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:40:19.570217 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9956e0a3-dce9-477d-9b9e-3ff3dcade69b service glance] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:40:19.581333 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 548/1092] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 15:40:19 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:40:21.950291 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbadf8d-a1bf-490c-915d-af6ae8bd9576 None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:40:21.950792 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbadf8d-a1bf-490c-915d-af6ae8bd9576 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:40:21.950924 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbadf8d-a1bf-490c-915d-af6ae8bd9576 None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:40:21.952454 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 545/1093] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:40:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:40:21.957750 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dc15fe-c0e7-465f-a1be-31e12bc3a30e None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:40:21.958221 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dc15fe-c0e7-465f-a1be-31e12bc3a30e None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:40:21.958354 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dc15fe-c0e7-465f-a1be-31e12bc3a30e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:40:21.977544 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-06dc15fe-c0e7-465f-a1be-31e12bc3a30e None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:40:21.978762 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-06dc15fe-c0e7-465f-a1be-31e12bc3a30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:40:21.987414 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 549/1094] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:40:21 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:40:22.011682 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbadf8d-a1bf-490c-915d-af6ae8bd9576 None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:40:22.024172 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbadf8d-a1bf-490c-915d-af6ae8bd9576 None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:40:22.028602 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19d9333-baf0-4da1-8975-2b578c176db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1316e00006b74e70a667f12420c63a2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:40:22.029215 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d9333-baf0-4da1-8975-2b578c176db4 admin admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:40:22.029499 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d9333-baf0-4da1-8975-2b578c176db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:40:22.029777 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d9333-baf0-4da1-8975-2b578c176db4 admin admin] PATH_INFO: `/v3/projects` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:40:22.030472 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19d9333-baf0-4da1-8975-2b578c176db4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:40:22.032306 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: WARNING py.warnings [None req-a19d9333-baf0-4da1-8975-2b578c176db4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 15:40:22.032306 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: warnings.warn(msg) Jul 26 15:40:22.032306 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: Jul 26 15:40:22.033483 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19d9333-baf0-4da1-8975-2b578c176db4 admin admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:40:22.052421 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 546/1095] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 15:40:22 2022] GET /identity/v3/projects => generated 1606 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:40:24.319430 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c38104-ecf7-4afe-a0c9-f87a009ca7d5 None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:40:24.320006 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c38104-ecf7-4afe-a0c9-f87a009ca7d5 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:40:24.320006 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c38104-ecf7-4afe-a0c9-f87a009ca7d5 None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:40:24.321349 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 550/1096] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:40:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:40:24.326676 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67abd24c-e239-47a4-8574-56f69a07fe17 None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:40:24.327079 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67abd24c-e239-47a4-8574-56f69a07fe17 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:40:24.327262 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67abd24c-e239-47a4-8574-56f69a07fe17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:40:24.347743 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-67abd24c-e239-47a4-8574-56f69a07fe17 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:40:24.349416 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-67abd24c-e239-47a4-8574-56f69a07fe17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:40:24.356982 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 547/1097] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:40:24 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:40:24.406501 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c38104-ecf7-4afe-a0c9-f87a009ca7d5 None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:40:24.426994 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c38104-ecf7-4afe-a0c9-f87a009ca7d5 None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:40:24.432055 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b365fe3f-1e09-4e96-bab1-61aa9c2221ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc5f2b36d3f45f1b3c8155e46c46fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9178e468facc41d6a7d828dfcd5301b4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:40:24.432703 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b365fe3f-1e09-4e96-bab1-61aa9c2221ad service nova] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:40:24.432976 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b365fe3f-1e09-4e96-bab1-61aa9c2221ad service nova] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:40:24.433265 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b365fe3f-1e09-4e96-bab1-61aa9c2221ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:40:24.442671 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b365fe3f-1e09-4e96-bab1-61aa9c2221ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:40:24.444316 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b365fe3f-1e09-4e96-bab1-61aa9c2221ad service nova] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:40:24.455607 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 551/1098] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 15:40:24 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:40:26.988715 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5921a3-28f7-4014-9229-50633b9d1a25 None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:40:26.989279 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5921a3-28f7-4014-9229-50633b9d1a25 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:40:26.989279 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5921a3-28f7-4014-9229-50633b9d1a25 None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:40:26.990704 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 548/1099] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:40:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:40:26.996414 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc7a0c-abff-472f-814c-a200ca00ec04 None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:40:26.996861 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc7a0c-abff-472f-814c-a200ca00ec04 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:40:27.004005 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc7a0c-abff-472f-814c-a200ca00ec04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:40:27.017102 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-8edc7a0c-abff-472f-814c-a200ca00ec04 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:40:27.018336 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-8edc7a0c-abff-472f-814c-a200ca00ec04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:40:27.026304 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 552/1100] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:40:26 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:40:27.064634 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5921a3-28f7-4014-9229-50633b9d1a25 None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:40:27.075466 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5921a3-28f7-4014-9229-50633b9d1a25 None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:40:27.078986 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df54331-864d-456b-a35c-12e3c3ce39cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960c230d1e8841e6b231fdbf4d172cc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9178e468facc41d6a7d828dfcd5301b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:40:27.079612 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df54331-864d-456b-a35c-12e3c3ce39cc service neutron] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:40:27.079895 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df54331-864d-456b-a35c-12e3c3ce39cc service neutron] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:40:27.080170 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df54331-864d-456b-a35c-12e3c3ce39cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:40:27.089368 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df54331-864d-456b-a35c-12e3c3ce39cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:40:27.090833 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df54331-864d-456b-a35c-12e3c3ce39cc service neutron] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:40:27.100546 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 549/1101] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 15:40:27 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:40:29.402571 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1510c0a6-0c5d-477d-ae4b-26915defc824 None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:40:29.403269 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1510c0a6-0c5d-477d-ae4b-26915defc824 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:40:29.403269 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1510c0a6-0c5d-477d-ae4b-26915defc824 None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:40:29.404638 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 553/1102] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:40:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:40:29.410623 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e85e78e-11a5-480a-a161-22ac7ca6daba None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:40:29.411201 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e85e78e-11a5-480a-a161-22ac7ca6daba None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:40:29.411311 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e85e78e-11a5-480a-a161-22ac7ca6daba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:40:29.432252 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-6e85e78e-11a5-480a-a161-22ac7ca6daba None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:40:29.433498 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-6e85e78e-11a5-480a-a161-22ac7ca6daba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:40:29.442103 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 550/1103] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:40:29 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:40:29.481621 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1510c0a6-0c5d-477d-ae4b-26915defc824 None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:40:29.493392 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1510c0a6-0c5d-477d-ae4b-26915defc824 None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:40:29.497082 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef1af42-5740-41ed-8ad7-81921ae8e2cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960c230d1e8841e6b231fdbf4d172cc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9178e468facc41d6a7d828dfcd5301b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:40:29.497707 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef1af42-5740-41ed-8ad7-81921ae8e2cf service neutron] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:40:29.497991 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef1af42-5740-41ed-8ad7-81921ae8e2cf service neutron] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:40:29.498265 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef1af42-5740-41ed-8ad7-81921ae8e2cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:40:29.508957 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef1af42-5740-41ed-8ad7-81921ae8e2cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:40:29.510431 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef1af42-5740-41ed-8ad7-81921ae8e2cf service neutron] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:40:29.521173 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 554/1104] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 15:40:29 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:40:31.882270 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ac9c6-efe9-4cb6-912f-5248e5aeb4b2 None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:40:31.882857 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ac9c6-efe9-4cb6-912f-5248e5aeb4b2 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:40:31.882857 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ac9c6-efe9-4cb6-912f-5248e5aeb4b2 None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:40:31.884197 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 551/1105] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:40:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:40:31.889632 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821c371-43b1-4b15-a4b2-dee34eff5d77 None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:40:31.890079 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821c371-43b1-4b15-a4b2-dee34eff5d77 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:40:31.890190 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821c371-43b1-4b15-a4b2-dee34eff5d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:40:31.909975 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-c821c371-43b1-4b15-a4b2-dee34eff5d77 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:40:31.911226 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-c821c371-43b1-4b15-a4b2-dee34eff5d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:40:31.919527 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 555/1106] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:40:31 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:40:31.962009 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9ac9c6-efe9-4cb6-912f-5248e5aeb4b2 None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:40:31.972616 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9ac9c6-efe9-4cb6-912f-5248e5aeb4b2 None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:40:31.977017 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923f61d9-a623-42b4-9d1b-242377b92a9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960c230d1e8841e6b231fdbf4d172cc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9178e468facc41d6a7d828dfcd5301b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:40:31.977496 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f61d9-a623-42b4-9d1b-242377b92a9e service neutron] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:40:31.977779 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f61d9-a623-42b4-9d1b-242377b92a9e service neutron] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:40:31.978053 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f61d9-a623-42b4-9d1b-242377b92a9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:40:31.988500 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923f61d9-a623-42b4-9d1b-242377b92a9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:40:31.989993 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923f61d9-a623-42b4-9d1b-242377b92a9e service neutron] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:40:32.000305 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 552/1107] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 15:40:31 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:40:34.772485 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9807d-e51c-4b61-8c35-bfacd945fefe None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:40:34.773110 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9807d-e51c-4b61-8c35-bfacd945fefe None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:40:34.773110 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9807d-e51c-4b61-8c35-bfacd945fefe None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:40:34.774313 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 556/1108] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 15:40:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:40:34.779851 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba4d25-a31d-4f2a-9c12-d8b6b96dd2ee None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:40:34.780308 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba4d25-a31d-4f2a-9c12-d8b6b96dd2ee None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:40:34.780557 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba4d25-a31d-4f2a-9c12-d8b6b96dd2ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:40:34.801012 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-1dba4d25-a31d-4f2a-9c12-d8b6b96dd2ee None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:40:34.802227 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-1dba4d25-a31d-4f2a-9c12-d8b6b96dd2ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:40:34.810394 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 553/1109] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 15:40:34 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:40:34.860795 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d9807d-e51c-4b61-8c35-bfacd945fefe None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:40:34.871519 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d9807d-e51c-4b61-8c35-bfacd945fefe None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:40:34.875047 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240c8935-ee2b-4aad-b018-b5f73a6ccace service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960c230d1e8841e6b231fdbf4d172cc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9178e468facc41d6a7d828dfcd5301b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:40:34.876182 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c8935-ee2b-4aad-b018-b5f73a6ccace service neutron] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:40:34.876471 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c8935-ee2b-4aad-b018-b5f73a6ccace service neutron] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:40:34.876746 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c8935-ee2b-4aad-b018-b5f73a6ccace service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:40:34.886145 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240c8935-ee2b-4aad-b018-b5f73a6ccace service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:40:34.887638 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240c8935-ee2b-4aad-b018-b5f73a6ccace service neutron] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:40:34.898006 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 557/1110] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 15:40:34 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:40:44.796107 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=33 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:40:44.893531 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=33 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:42:18.996968 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92696563-ca1a-4241-8797-1011876b5042 None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:42:18.997592 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92696563-ca1a-4241-8797-1011876b5042 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:42:18.997592 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92696563-ca1a-4241-8797-1011876b5042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:42:19.017166 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-92696563-ca1a-4241-8797-1011876b5042 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:42:19.018384 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-92696563-ca1a-4241-8797-1011876b5042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:42:19.026304 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 554/1111] 10.222.0.18 () {58 vars in 958 bytes} [Tue Jul 26 15:42:18 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:42:19.035357 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71410886-0501-4078-8b33-2e7bcd16c96f None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:42:19.035911 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71410886-0501-4078-8b33-2e7bcd16c96f None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:42:19.035911 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71410886-0501-4078-8b33-2e7bcd16c96f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:42:19.055577 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-71410886-0501-4078-8b33-2e7bcd16c96f None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:42:19.056797 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-71410886-0501-4078-8b33-2e7bcd16c96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:42:19.064806 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 558/1112] 10.222.0.18 () {58 vars in 958 bytes} [Tue Jul 26 15:42:19 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:42:19.069466 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92696563-ca1a-4241-8797-1011876b5042 None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:42:19.079790 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92696563-ca1a-4241-8797-1011876b5042 None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:42:19.084370 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1be36b-8ab4-41ae-97e4-2e2acc79a3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1316e00006b74e70a667f12420c63a2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:42:19.084975 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1be36b-8ab4-41ae-97e4-2e2acc79a3d1 admin admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:42:19.085262 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1be36b-8ab4-41ae-97e4-2e2acc79a3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:42:19.085540 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1be36b-8ab4-41ae-97e4-2e2acc79a3d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:42:19.086233 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1be36b-8ab4-41ae-97e4-2e2acc79a3d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:42:19.086543 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1be36b-8ab4-41ae-97e4-2e2acc79a3d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:42:19.087623 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: WARNING py.warnings [None req-4f1be36b-8ab4-41ae-97e4-2e2acc79a3d1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 15:42:19.087623 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: warnings.warn(msg) Jul 26 15:42:19.087623 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: Jul 26 15:42:19.088575 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1be36b-8ab4-41ae-97e4-2e2acc79a3d1 admin admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:42:19.100769 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 555/1113] 10.222.0.18 () {58 vars in 1153 bytes} [Tue Jul 26 15:42:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:42:19.109157 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71410886-0501-4078-8b33-2e7bcd16c96f None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:42:19.118342 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71410886-0501-4078-8b33-2e7bcd16c96f None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:42:19.123336 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8049f13-d337-4553-be83-5c62b4747ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1316e00006b74e70a667f12420c63a2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:42:19.123951 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8049f13-d337-4553-be83-5c62b4747ae7 admin admin] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:42:19.124238 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8049f13-d337-4553-be83-5c62b4747ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:42:19.125050 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8049f13-d337-4553-be83-5c62b4747ae7 admin admin] PATH_INFO: `/v3/projects` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:42:19.125720 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8049f13-d337-4553-be83-5c62b4747ae7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:42:19.127561 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: WARNING py.warnings [None req-a8049f13-d337-4553-be83-5c62b4747ae7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 15:42:19.127561 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: warnings.warn(msg) Jul 26 15:42:19.127561 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: Jul 26 15:42:19.128815 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8049f13-d337-4553-be83-5c62b4747ae7 admin admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:42:19.247712 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 559/1114] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Jul 26 15:42:19 2022] POST /identity/v3/projects => generated 377 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:42:19.252570 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1be36b-8ab4-41ae-97e4-2e2acc79a3d1 admin admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:42:19.262662 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1be36b-8ab4-41ae-97e4-2e2acc79a3d1 admin admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:42:19.320563 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adccee6-d687-42cb-b28e-2f07da07231e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1316e00006b74e70a667f12420c63a2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:42:19.320903 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adccee6-d687-42cb-b28e-2f07da07231e admin admin] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:42:19.321268 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adccee6-d687-42cb-b28e-2f07da07231e admin admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:42:19.321679 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adccee6-d687-42cb-b28e-2f07da07231e admin admin] PATH_INFO: `/v3/users` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:42:19.322627 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adccee6-d687-42cb-b28e-2f07da07231e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:42:19.323749 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: WARNING py.warnings [None req-6adccee6-d687-42cb-b28e-2f07da07231e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 15:42:19.323749 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: warnings.warn(msg) Jul 26 15:42:19.323749 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: Jul 26 15:42:19.324994 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adccee6-d687-42cb-b28e-2f07da07231e admin admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:42:19.423542 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 556/1115] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Jul 26 15:42:19 2022] POST /identity/v3/users => generated 289 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:42:19.427746 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8049f13-d337-4553-be83-5c62b4747ae7 admin admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:42:19.438151 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8049f13-d337-4553-be83-5c62b4747ae7 admin admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:42:19.443024 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1015b9d-df9c-4bd2-84fc-b3094474a982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1316e00006b74e70a667f12420c63a2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:42:19.443698 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1015b9d-df9c-4bd2-84fc-b3094474a982 admin admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:42:19.443989 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1015b9d-df9c-4bd2-84fc-b3094474a982 admin admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:42:19.444275 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1015b9d-df9c-4bd2-84fc-b3094474a982 admin admin] PATH_INFO: `/v3/roles` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:42:19.444987 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1015b9d-df9c-4bd2-84fc-b3094474a982 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:42:19.446029 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: WARNING py.warnings [None req-b1015b9d-df9c-4bd2-84fc-b3094474a982 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 15:42:19.446029 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: warnings.warn(msg) Jul 26 15:42:19.446029 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: Jul 26 15:42:19.446985 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1015b9d-df9c-4bd2-84fc-b3094474a982 admin admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:42:19.462689 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 560/1116] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Jul 26 15:42:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:42:19.467037 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adccee6-d687-42cb-b28e-2f07da07231e admin admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:42:19.477999 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adccee6-d687-42cb-b28e-2f07da07231e admin admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:42:19.482736 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9f9017-6060-4e37-97f4-919fcc1bdcf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1316e00006b74e70a667f12420c63a2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:42:19.483419 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9f9017-6060-4e37-97f4-919fcc1bdcf1 admin admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:42:19.484364 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9f9017-6060-4e37-97f4-919fcc1bdcf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:42:19.484671 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9f9017-6060-4e37-97f4-919fcc1bdcf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:42:19.485378 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9f9017-6060-4e37-97f4-919fcc1bdcf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:42:19.486433 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: WARNING py.warnings [None req-9e9f9017-6060-4e37-97f4-919fcc1bdcf1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 15:42:19.486433 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: warnings.warn(msg) Jul 26 15:42:19.486433 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: Jul 26 15:42:19.487374 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9f9017-6060-4e37-97f4-919fcc1bdcf1 admin admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:42:19.501927 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 557/1117] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Jul 26 15:42:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:42:19.506346 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1015b9d-df9c-4bd2-84fc-b3094474a982 admin admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:42:19.517189 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1015b9d-df9c-4bd2-84fc-b3094474a982 admin admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:42:19.522055 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee81f184-8116-4e64-a71f-1ce64823c7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1316e00006b74e70a667f12420c63a2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:42:19.522754 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81f184-8116-4e64-a71f-1ce64823c7bb admin admin] REQUEST_METHOD: `PUT` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:42:19.523039 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81f184-8116-4e64-a71f-1ce64823c7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:42:19.523353 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81f184-8116-4e64-a71f-1ce64823c7bb admin admin] PATH_INFO: `/v3/projects/42c574e0a0e54a36b0a7a87c4d9526c7/users/bfe5a98b81e4426abdc6fd5999feeb85/roles/fd8f80bccab248edbb1d09ec187a8113` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:42:19.540419 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee81f184-8116-4e64-a71f-1ce64823c7bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=42c574e0a0e54a36b0a7a87c4d9526c7, user_id=bfe5a98b81e4426abdc6fd5999feeb85, role_id=fd8f80bccab248edbb1d09ec187a8113)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:42:19.541725 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: WARNING py.warnings [None req-ee81f184-8116-4e64-a71f-1ce64823c7bb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 15:42:19.541725 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: warnings.warn(msg) Jul 26 15:42:19.541725 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: Jul 26 15:42:19.543730 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee81f184-8116-4e64-a71f-1ce64823c7bb admin admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:42:19.642484 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 561/1118] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Jul 26 15:42:19 2022] PUT /identity/v3/projects/42c574e0a0e54a36b0a7a87c4d9526c7/users/bfe5a98b81e4426abdc6fd5999feeb85/roles/fd8f80bccab248edbb1d09ec187a8113 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:42:19.655184 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2337cf34-4c33-4edf-bdc9-bf6b1c3e8ad4 None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:42:19.655622 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2337cf34-4c33-4edf-bdc9-bf6b1c3e8ad4 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:42:19.656610 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2337cf34-4c33-4edf-bdc9-bf6b1c3e8ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:42:19.685407 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-2337cf34-4c33-4edf-bdc9-bf6b1c3e8ad4 None None] MFA Rules not processed for user `bfe5a98b81e4426abdc6fd5999feeb85`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:42:19.686644 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-2337cf34-4c33-4edf-bdc9-bf6b1c3e8ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:42:19.752028 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 558/1119] 10.222.0.18 () {58 vars in 958 bytes} [Tue Jul 26 15:42:19 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:42:19.765823 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2101a549-2f76-4785-970b-f8a1a8c209f9 None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:42:19.766110 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2101a549-2f76-4785-970b-f8a1a8c209f9 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:42:19.766413 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2101a549-2f76-4785-970b-f8a1a8c209f9 None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:42:19.767822 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 562/1120] 10.222.0.18 () {54 vars in 964 bytes} [Tue Jul 26 15:42:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:42:19.772860 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f314ed0-f54d-49a3-bb25-a8de468ca4a2 None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:42:19.773151 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f314ed0-f54d-49a3-bb25-a8de468ca4a2 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:42:19.773440 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f314ed0-f54d-49a3-bb25-a8de468ca4a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:42:19.793660 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-4f314ed0-f54d-49a3-bb25-a8de468ca4a2 None None] MFA Rules not processed for user `279031fbf2114c11883018b0d41e243a`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:42:19.794929 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-4f314ed0-f54d-49a3-bb25-a8de468ca4a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:42:19.838920 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:42:19.846346 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 559/1121] 10.222.0.18 () {58 vars in 1061 bytes} [Tue Jul 26 15:42:19 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:42:19.854019 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2101a549-2f76-4785-970b-f8a1a8c209f9 None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:42:19.865428 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2101a549-2f76-4785-970b-f8a1a8c209f9 None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:42:19.869066 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2db898-cfc7-4954-ac1b-3a3fbdef1dcb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '279031fbf2114c11883018b0d41e243a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9178e468facc41d6a7d828dfcd5301b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:42:19.869678 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2db898-cfc7-4954-ac1b-3a3fbdef1dcb service cinder] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:42:19.869959 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2db898-cfc7-4954-ac1b-3a3fbdef1dcb service cinder] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:42:19.870233 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2db898-cfc7-4954-ac1b-3a3fbdef1dcb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:42:19.879344 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2db898-cfc7-4954-ac1b-3a3fbdef1dcb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:42:19.880793 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2db898-cfc7-4954-ac1b-3a3fbdef1dcb service cinder] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:42:19.890031 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 563/1122] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 15:42:19 2022] GET /identity/v3/auth/tokens => generated 2804 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:42:19.930262 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78831b58-de08-4a8e-b379-def2a486f9ed None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:42:19.930561 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78831b58-de08-4a8e-b379-def2a486f9ed None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:42:19.930850 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78831b58-de08-4a8e-b379-def2a486f9ed None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:42:19.932180 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 560/1123] 10.222.0.18 () {52 vars in 830 bytes} [Tue Jul 26 15:42:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:42:19.935891 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2db898-cfc7-4954-ac1b-3a3fbdef1dcb service cinder] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:42:20.002602 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2db898-cfc7-4954-ac1b-3a3fbdef1dcb service cinder] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:42:20.008684 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172d5dae-1f65-4cc9-b833-3d2e7405cede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1316e00006b74e70a667f12420c63a2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:42:20.009464 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d5dae-1f65-4cc9-b833-3d2e7405cede admin admin] REQUEST_METHOD: `DELETE` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:42:20.009744 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d5dae-1f65-4cc9-b833-3d2e7405cede admin admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:42:20.010017 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d5dae-1f65-4cc9-b833-3d2e7405cede admin admin] PATH_INFO: `/v3/users/bfe5a98b81e4426abdc6fd5999feeb85` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:42:20.011259 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172d5dae-1f65-4cc9-b833-3d2e7405cede admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfe5a98b81e4426abdc6fd5999feeb85)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:42:20.012271 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: WARNING py.warnings [None req-172d5dae-1f65-4cc9-b833-3d2e7405cede admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 15:42:20.012271 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: warnings.warn(msg) Jul 26 15:42:20.012271 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: Jul 26 15:42:20.013482 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172d5dae-1f65-4cc9-b833-3d2e7405cede admin admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:42:20.241772 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.notifications [None req-172d5dae-1f65-4cc9-b833-3d2e7405cede admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfe5a98b81e4426abdc6fd5999feeb85'} {{(pid=87362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:42:20.254323 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.notifications [None req-172d5dae-1f65-4cc9-b833-3d2e7405cede admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfe5a98b81e4426abdc6fd5999feeb85'} {{(pid=87362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:42:20.254957 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.notifications [None req-172d5dae-1f65-4cc9-b833-3d2e7405cede admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfe5a98b81e4426abdc6fd5999feeb85'} {{(pid=87362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:42:20.255710 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.notifications [None req-172d5dae-1f65-4cc9-b833-3d2e7405cede admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfe5a98b81e4426abdc6fd5999feeb85'} {{(pid=87362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:42:20.337529 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.notifications [None req-172d5dae-1f65-4cc9-b833-3d2e7405cede admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfe5a98b81e4426abdc6fd5999feeb85'} {{(pid=87362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:42:20.357397 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:42:20.365937 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 564/1124] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Jul 26 15:42:19 2022] DELETE /identity/v3/users/bfe5a98b81e4426abdc6fd5999feeb85 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:42:20.371724 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e29f3b5-482b-4842-ad61-b5540c7f2107 None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:42:20.372267 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e29f3b5-482b-4842-ad61-b5540c7f2107 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:42:20.372267 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e29f3b5-482b-4842-ad61-b5540c7f2107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:42:20.394729 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-2e29f3b5-482b-4842-ad61-b5540c7f2107 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:42:20.396012 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-2e29f3b5-482b-4842-ad61-b5540c7f2107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:42:20.457748 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 561/1125] 10.222.0.18 () {58 vars in 958 bytes} [Tue Jul 26 15:42:20 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:42:20.468172 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172d5dae-1f65-4cc9-b833-3d2e7405cede admin admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:42:20.470210 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-172d5dae-1f65-4cc9-b833-3d2e7405cede admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:42:20.529148 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172d5dae-1f65-4cc9-b833-3d2e7405cede admin admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:42:20.533436 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecff4f61-31d1-4515-b835-088826276f0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960c230d1e8841e6b231fdbf4d172cc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9178e468facc41d6a7d828dfcd5301b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:42:20.534064 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecff4f61-31d1-4515-b835-088826276f0e service neutron] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:42:20.534350 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecff4f61-31d1-4515-b835-088826276f0e service neutron] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:42:20.534629 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecff4f61-31d1-4515-b835-088826276f0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:42:20.544377 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecff4f61-31d1-4515-b835-088826276f0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:42:20.545827 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecff4f61-31d1-4515-b835-088826276f0e service neutron] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:42:20.555822 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 565/1126] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 15:42:20 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:42:21.025061 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e29f3b5-482b-4842-ad61-b5540c7f2107 None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:42:21.026826 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-2e29f3b5-482b-4842-ad61-b5540c7f2107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:42:21.040089 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e29f3b5-482b-4842-ad61-b5540c7f2107 None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:42:21.045254 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1968966-d921-42fe-aaf3-bf259f05f34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1316e00006b74e70a667f12420c63a2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:42:21.045915 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1968966-d921-42fe-aaf3-bf259f05f34c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:42:21.046895 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1968966-d921-42fe-aaf3-bf259f05f34c admin admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:42:21.047207 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1968966-d921-42fe-aaf3-bf259f05f34c admin admin] PATH_INFO: `/v3/projects/42c574e0a0e54a36b0a7a87c4d9526c7` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:42:21.048426 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1968966-d921-42fe-aaf3-bf259f05f34c admin admin] RBAC: Authorizing `identity:delete_project(project_id=42c574e0a0e54a36b0a7a87c4d9526c7)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:42:21.055208 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: WARNING py.warnings [None req-b1968966-d921-42fe-aaf3-bf259f05f34c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 15:42:21.055208 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: warnings.warn(msg) Jul 26 15:42:21.055208 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: Jul 26 15:42:21.055208 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1968966-d921-42fe-aaf3-bf259f05f34c admin admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:42:21.201476 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.notifications [None req-b1968966-d921-42fe-aaf3-bf259f05f34c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42c574e0a0e54a36b0a7a87c4d9526c7', 'request_id': 'req-b1968966-d921-42fe-aaf3-bf259f05f34c'} {{(pid=87363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:42:21.268891 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.notifications [None req-b1968966-d921-42fe-aaf3-bf259f05f34c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42c574e0a0e54a36b0a7a87c4d9526c7', 'request_id': 'req-b1968966-d921-42fe-aaf3-bf259f05f34c'} {{(pid=87363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:42:21.286328 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.notifications [None req-b1968966-d921-42fe-aaf3-bf259f05f34c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42c574e0a0e54a36b0a7a87c4d9526c7', 'request_id': 'req-b1968966-d921-42fe-aaf3-bf259f05f34c'} {{(pid=87363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:42:21.297987 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.notifications [None req-b1968966-d921-42fe-aaf3-bf259f05f34c admin admin] The token cache is being invalidate because project 42c574e0a0e54a36b0a7a87c4d9526c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:42:21.298257 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.notifications [None req-b1968966-d921-42fe-aaf3-bf259f05f34c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:42:21.299025 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.notifications [None req-b1968966-d921-42fe-aaf3-bf259f05f34c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:42:21.301363 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 562/1127] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Jul 26 15:42:21 2022] DELETE /identity/v3/projects/42c574e0a0e54a36b0a7a87c4d9526c7 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:42:30.551213 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:42:31.294425 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:43:49.792439 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f47d59-7ce2-4c42-b820-1c82f34431b9 None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:43:49.793055 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f47d59-7ce2-4c42-b820-1c82f34431b9 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:43:49.793055 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f47d59-7ce2-4c42-b820-1c82f34431b9 None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:43:49.794621 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 566/1128] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 15:43:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:43:49.800546 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf189f8f-e35e-4977-bbff-d18b47b8bd02 None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:43:49.801060 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf189f8f-e35e-4977-bbff-d18b47b8bd02 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:43:49.801161 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf189f8f-e35e-4977-bbff-d18b47b8bd02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:43:49.822483 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-cf189f8f-e35e-4977-bbff-d18b47b8bd02 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:43:49.823762 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-cf189f8f-e35e-4977-bbff-d18b47b8bd02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:43:49.885498 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 563/1129] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 15:43:49 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:43:50.045998 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f47d59-7ce2-4c42-b820-1c82f34431b9 None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:43:50.047862 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-d3f47d59-7ce2-4c42-b820-1c82f34431b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:43:50.117308 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f47d59-7ce2-4c42-b820-1c82f34431b9 None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:43:50.122385 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194c1063-f65b-4e71-a83e-afb52d68b071 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc5f2b36d3f45f1b3c8155e46c46fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9178e468facc41d6a7d828dfcd5301b4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:43:50.123009 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c1063-f65b-4e71-a83e-afb52d68b071 service nova] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:43:50.123335 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c1063-f65b-4e71-a83e-afb52d68b071 service nova] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:43:50.123619 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c1063-f65b-4e71-a83e-afb52d68b071 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:43:50.131760 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194c1063-f65b-4e71-a83e-afb52d68b071 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:43:50.133353 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194c1063-f65b-4e71-a83e-afb52d68b071 service nova] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:43:50.142719 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 567/1130] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 15:43:50 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:43:50.983511 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a38fc-36f6-4e13-a37e-98c3047595b3 None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:43:50.984010 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a38fc-36f6-4e13-a37e-98c3047595b3 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:43:50.984010 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a38fc-36f6-4e13-a37e-98c3047595b3 None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:43:50.985275 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 564/1131] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 15:43:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:43:50.990913 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ed40b-b846-4dbf-b06e-35efea8cf173 None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:43:50.991364 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ed40b-b846-4dbf-b06e-35efea8cf173 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:43:50.991493 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ed40b-b846-4dbf-b06e-35efea8cf173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:43:51.013361 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-991ed40b-b846-4dbf-b06e-35efea8cf173 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:43:51.014525 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-991ed40b-b846-4dbf-b06e-35efea8cf173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:43:51.023373 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 568/1132] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 15:43:50 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:43:51.184816 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148a38fc-36f6-4e13-a37e-98c3047595b3 None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:43:51.198871 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148a38fc-36f6-4e13-a37e-98c3047595b3 None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:43:51.204081 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aad8cf-884a-477e-8d20-4a5340971e6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc5f2b36d3f45f1b3c8155e46c46fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9178e468facc41d6a7d828dfcd5301b4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:43:51.204719 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aad8cf-884a-477e-8d20-4a5340971e6f service nova] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:43:51.205005 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aad8cf-884a-477e-8d20-4a5340971e6f service nova] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:43:51.205285 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aad8cf-884a-477e-8d20-4a5340971e6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:43:51.214434 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aad8cf-884a-477e-8d20-4a5340971e6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:43:51.216112 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aad8cf-884a-477e-8d20-4a5340971e6f service nova] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:43:51.225466 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 565/1133] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 15:43:51 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:43:55.826716 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a55c2-8e9e-4770-8e06-9fd076119558 None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:43:55.827330 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a55c2-8e9e-4770-8e06-9fd076119558 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:43:55.827330 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a55c2-8e9e-4770-8e06-9fd076119558 None None] PATH_INFO: `/v3` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:43:55.828509 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 569/1134] 10.222.0.109 () {54 vars in 926 bytes} [Tue Jul 26 15:43:55 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:43:55.834765 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a3f27-1cb3-4208-b3f1-161e6918f524 None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:43:55.835204 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a3f27-1cb3-4208-b3f1-161e6918f524 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:43:55.835394 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a3f27-1cb3-4208-b3f1-161e6918f524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:43:55.856213 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-c73a3f27-1cb3-4208-b3f1-161e6918f524 None None] MFA Rules not processed for user `21a7f59ebf1b40a1b76ee2002ae38230`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:43:55.857440 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-c73a3f27-1cb3-4208-b3f1-161e6918f524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:43:55.924628 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 566/1135] 10.222.0.109 () {58 vars in 1016 bytes} [Tue Jul 26 15:43:55 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:44:00.124690 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a702134-bb30-4821-97ad-6c1566289f71 None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:44:00.125516 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a702134-bb30-4821-97ad-6c1566289f71 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:44:00.125697 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a702134-bb30-4821-97ad-6c1566289f71 None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:44:00.127310 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 570/1136] 10.222.0.18 () {54 vars in 961 bytes} [Tue Jul 26 15:44:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:44:00.132450 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960dc51d-5c9c-4fc3-be0a-aa75d86ae604 None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:44:00.132880 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960dc51d-5c9c-4fc3-be0a-aa75d86ae604 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:44:00.133019 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960dc51d-5c9c-4fc3-be0a-aa75d86ae604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:44:00.152030 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-960dc51d-5c9c-4fc3-be0a-aa75d86ae604 None None] MFA Rules not processed for user `21a7f59ebf1b40a1b76ee2002ae38230`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:44:00.153283 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-960dc51d-5c9c-4fc3-be0a-aa75d86ae604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:44:00.162261 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 567/1137] 10.222.0.18 () {58 vars in 1058 bytes} [Tue Jul 26 15:44:00 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:44:00.169692 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a702134-bb30-4821-97ad-6c1566289f71 None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:44:00.183684 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a702134-bb30-4821-97ad-6c1566289f71 None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:44:00.188597 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aba91ad-a72b-49a2-98d4-7f955051b50a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21a7f59ebf1b40a1b76ee2002ae38230', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9178e468facc41d6a7d828dfcd5301b4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:44:00.189206 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba91ad-a72b-49a2-98d4-7f955051b50a service placement] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:44:00.189494 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba91ad-a72b-49a2-98d4-7f955051b50a service placement] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:44:00.189777 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba91ad-a72b-49a2-98d4-7f955051b50a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:44:00.198282 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aba91ad-a72b-49a2-98d4-7f955051b50a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:44:00.199973 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aba91ad-a72b-49a2-98d4-7f955051b50a service placement] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:44:00.209600 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 571/1138] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 15:44:00 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:44:02.467841 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5096d78d-5ed6-41ef-af93-11506a2ad136 None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:44:02.468421 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5096d78d-5ed6-41ef-af93-11506a2ad136 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:44:02.468421 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5096d78d-5ed6-41ef-af93-11506a2ad136 None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:44:02.469823 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 568/1139] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 15:44:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:44:02.474827 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259621b2-479e-4012-99e8-d93b66a2ab23 None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:44:02.475285 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259621b2-479e-4012-99e8-d93b66a2ab23 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:44:02.475416 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259621b2-479e-4012-99e8-d93b66a2ab23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:44:02.494633 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-259621b2-479e-4012-99e8-d93b66a2ab23 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:44:02.495905 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-259621b2-479e-4012-99e8-d93b66a2ab23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:44:02.504145 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 572/1140] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 15:44:02 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:44:02.664228 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5096d78d-5ed6-41ef-af93-11506a2ad136 None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:44:02.678356 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5096d78d-5ed6-41ef-af93-11506a2ad136 None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:44:02.683308 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02a40d5-bc42-4853-93ab-d623c5c41693 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc5f2b36d3f45f1b3c8155e46c46fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9178e468facc41d6a7d828dfcd5301b4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:44:02.683915 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a40d5-bc42-4853-93ab-d623c5c41693 service nova] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:44:02.684196 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a40d5-bc42-4853-93ab-d623c5c41693 service nova] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:44:02.684472 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a40d5-bc42-4853-93ab-d623c5c41693 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:44:02.693606 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02a40d5-bc42-4853-93ab-d623c5c41693 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:44:02.695254 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02a40d5-bc42-4853-93ab-d623c5c41693 service nova] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:44:02.704511 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 569/1141] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 15:44:02 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:44:03.526970 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e380cf0-386e-4573-8d58-9e548c0210eb None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:44:03.527543 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e380cf0-386e-4573-8d58-9e548c0210eb None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:44:03.527543 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e380cf0-386e-4573-8d58-9e548c0210eb None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:44:03.528922 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 573/1142] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 15:44:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:44:03.533782 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64709d72-52c7-482d-9daf-e482d605cca0 None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:44:03.534227 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64709d72-52c7-482d-9daf-e482d605cca0 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:44:03.534337 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64709d72-52c7-482d-9daf-e482d605cca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:44:03.554218 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-64709d72-52c7-482d-9daf-e482d605cca0 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:44:03.555449 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-64709d72-52c7-482d-9daf-e482d605cca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:44:03.563625 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 570/1143] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 15:44:03 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:44:03.719717 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e380cf0-386e-4573-8d58-9e548c0210eb None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:44:03.734112 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e380cf0-386e-4573-8d58-9e548c0210eb None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:44:03.739940 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2845d782-2043-4c12-9cb4-06ae0745c167 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc5f2b36d3f45f1b3c8155e46c46fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9178e468facc41d6a7d828dfcd5301b4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:44:03.740561 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845d782-2043-4c12-9cb4-06ae0745c167 service nova] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:44:03.740849 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845d782-2043-4c12-9cb4-06ae0745c167 service nova] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:44:03.741132 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845d782-2043-4c12-9cb4-06ae0745c167 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:44:03.749684 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2845d782-2043-4c12-9cb4-06ae0745c167 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:44:03.751327 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2845d782-2043-4c12-9cb4-06ae0745c167 service nova] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:44:03.760803 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 574/1144] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 15:44:03 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:44:08.317781 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f8a10-7b88-4e6b-aff3-edce6c00bd62 None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:44:08.318475 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f8a10-7b88-4e6b-aff3-edce6c00bd62 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:44:08.318475 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f8a10-7b88-4e6b-aff3-edce6c00bd62 None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:44:08.319753 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 571/1145] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 15:44:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:44:08.325252 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d13a70-52ca-4ad7-8b10-76ad74a391f6 None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:44:08.325725 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d13a70-52ca-4ad7-8b10-76ad74a391f6 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:44:08.325832 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d13a70-52ca-4ad7-8b10-76ad74a391f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:44:08.346887 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-e8d13a70-52ca-4ad7-8b10-76ad74a391f6 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:44:08.348697 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-e8d13a70-52ca-4ad7-8b10-76ad74a391f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:44:08.356542 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 575/1146] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 15:44:08 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:44:08.395504 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79f8a10-7b88-4e6b-aff3-edce6c00bd62 None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:44:08.397197 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-f79f8a10-7b88-4e6b-aff3-edce6c00bd62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:44:08.455651 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79f8a10-7b88-4e6b-aff3-edce6c00bd62 None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:44:08.459295 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05ed7a2-473f-42e0-abbc-314feaedea0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960c230d1e8841e6b231fdbf4d172cc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9178e468facc41d6a7d828dfcd5301b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:44:08.459915 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05ed7a2-473f-42e0-abbc-314feaedea0a service neutron] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:44:08.460236 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05ed7a2-473f-42e0-abbc-314feaedea0a service neutron] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:44:08.460526 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05ed7a2-473f-42e0-abbc-314feaedea0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:44:08.469961 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05ed7a2-473f-42e0-abbc-314feaedea0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:44:08.471676 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05ed7a2-473f-42e0-abbc-314feaedea0a service neutron] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:44:08.477247 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:44:08.481894 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 572/1147] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 15:44:08 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:44:10.718064 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d3746d-f04b-482d-8734-20e26cce8ee3 None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:44:10.718669 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d3746d-f04b-482d-8734-20e26cce8ee3 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:44:10.718669 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d3746d-f04b-482d-8734-20e26cce8ee3 None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:44:10.720027 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 576/1148] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 15:44:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:44:10.726016 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b781c59-def4-40ff-8087-e84583b3cea5 None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:44:10.726447 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b781c59-def4-40ff-8087-e84583b3cea5 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:44:10.726565 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b781c59-def4-40ff-8087-e84583b3cea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:44:10.746889 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-1b781c59-def4-40ff-8087-e84583b3cea5 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:44:10.748243 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-1b781c59-def4-40ff-8087-e84583b3cea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:44:10.756721 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 573/1149] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 15:44:10 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:44:10.796632 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d3746d-f04b-482d-8734-20e26cce8ee3 None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:44:10.798480 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-d2d3746d-f04b-482d-8734-20e26cce8ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:44:10.807674 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=54 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:44:10.814280 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d3746d-f04b-482d-8734-20e26cce8ee3 None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:44:10.818127 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187be73e-66ab-497c-8fa6-c47f4b98c158 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960c230d1e8841e6b231fdbf4d172cc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9178e468facc41d6a7d828dfcd5301b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:44:10.818800 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187be73e-66ab-497c-8fa6-c47f4b98c158 service neutron] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:44:10.819118 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187be73e-66ab-497c-8fa6-c47f4b98c158 service neutron] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:44:10.819422 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187be73e-66ab-497c-8fa6-c47f4b98c158 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:44:10.829213 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187be73e-66ab-497c-8fa6-c47f4b98c158 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:44:10.830748 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187be73e-66ab-497c-8fa6-c47f4b98c158 service neutron] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:44:10.841567 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 577/1150] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 15:44:10 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:44:15.039298 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0802d9ed-bee5-45f3-87ea-f59df16493fa None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:44:15.039871 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0802d9ed-bee5-45f3-87ea-f59df16493fa None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:44:15.039871 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0802d9ed-bee5-45f3-87ea-f59df16493fa None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:44:15.041236 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 574/1151] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 15:44:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:44:15.046810 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3d161-2529-4fca-8cfd-f0a2d10e5522 None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:44:15.047691 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3d161-2529-4fca-8cfd-f0a2d10e5522 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:44:15.047979 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3d161-2529-4fca-8cfd-f0a2d10e5522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:44:15.192076 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-31a3d161-2529-4fca-8cfd-f0a2d10e5522 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:44:15.193224 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-31a3d161-2529-4fca-8cfd-f0a2d10e5522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:44:15.201193 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 578/1152] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 15:44:15 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:44:15.475687 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0802d9ed-bee5-45f3-87ea-f59df16493fa None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:44:15.477549 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-0802d9ed-bee5-45f3-87ea-f59df16493fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:44:15.533808 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0802d9ed-bee5-45f3-87ea-f59df16493fa None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:44:15.538029 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c22f7c-4215-4ee0-981d-756c65962c1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '279031fbf2114c11883018b0d41e243a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9178e468facc41d6a7d828dfcd5301b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:44:15.538651 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c22f7c-4215-4ee0-981d-756c65962c1a service cinder] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:44:15.538939 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c22f7c-4215-4ee0-981d-756c65962c1a service cinder] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:44:15.539253 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c22f7c-4215-4ee0-981d-756c65962c1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:44:15.548509 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c22f7c-4215-4ee0-981d-756c65962c1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:44:15.549967 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c22f7c-4215-4ee0-981d-756c65962c1a service cinder] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:44:15.562421 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 575/1153] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 15:44:15 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:44:17.826683 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a561d5a8-cdcd-4f2f-a2e6-865420afb090 None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:44:17.827334 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a561d5a8-cdcd-4f2f-a2e6-865420afb090 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:44:17.827334 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a561d5a8-cdcd-4f2f-a2e6-865420afb090 None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:44:17.828637 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 579/1154] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 15:44:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:44:17.834424 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba1eae2-4341-4805-bad4-33724bef8cc3 None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:44:17.834896 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba1eae2-4341-4805-bad4-33724bef8cc3 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:44:17.835041 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba1eae2-4341-4805-bad4-33724bef8cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:44:17.855603 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-eba1eae2-4341-4805-bad4-33724bef8cc3 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:44:17.856806 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-eba1eae2-4341-4805-bad4-33724bef8cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:44:17.864589 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 576/1155] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 15:44:17 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:44:18.132445 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a561d5a8-cdcd-4f2f-a2e6-865420afb090 None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:44:18.134135 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-a561d5a8-cdcd-4f2f-a2e6-865420afb090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:44:18.147610 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a561d5a8-cdcd-4f2f-a2e6-865420afb090 None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:44:18.151041 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c62a2a4-678a-4e5b-acd8-08950169e151 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '279031fbf2114c11883018b0d41e243a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9178e468facc41d6a7d828dfcd5301b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:44:18.151668 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c62a2a4-678a-4e5b-acd8-08950169e151 service cinder] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:44:18.151946 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c62a2a4-678a-4e5b-acd8-08950169e151 service cinder] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:44:18.152217 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c62a2a4-678a-4e5b-acd8-08950169e151 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:44:18.160887 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c62a2a4-678a-4e5b-acd8-08950169e151 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:44:18.162294 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c62a2a4-678a-4e5b-acd8-08950169e151 service cinder] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:44:18.171768 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 580/1156] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 15:44:18 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:44:27.849841 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=32 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:44:28.167561 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=14 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:45:39.575328 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd62b88a-5da7-4893-9618-6824411ab3e7 None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:45:39.577160 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd62b88a-5da7-4893-9618-6824411ab3e7 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:45:39.577160 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd62b88a-5da7-4893-9618-6824411ab3e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:45:39.590380 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb43bd6-633a-41a6-8279-7b7450c5306f None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:45:39.591096 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb43bd6-633a-41a6-8279-7b7450c5306f None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:45:39.591096 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb43bd6-633a-41a6-8279-7b7450c5306f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:45:39.598568 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-bd62b88a-5da7-4893-9618-6824411ab3e7 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:45:39.600981 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-bd62b88a-5da7-4893-9618-6824411ab3e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:45:39.610037 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 577/1157] 10.222.0.18 () {58 vars in 958 bytes} [Tue Jul 26 15:45:39 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:45:39.611502 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-7fb43bd6-633a-41a6-8279-7b7450c5306f None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:45:39.612740 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-7fb43bd6-633a-41a6-8279-7b7450c5306f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:45:39.618483 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd56841-4477-424f-9f69-05476a9d047f None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:45:39.625455 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd56841-4477-424f-9f69-05476a9d047f None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:45:39.625455 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd56841-4477-424f-9f69-05476a9d047f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:45:39.625666 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 581/1158] 10.222.0.18 () {58 vars in 958 bytes} [Tue Jul 26 15:45:39 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:45:39.632788 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d39b56-7545-4bcc-a002-c395fc0b4c3a None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:45:39.633070 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d39b56-7545-4bcc-a002-c395fc0b4c3a None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:45:39.633356 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d39b56-7545-4bcc-a002-c395fc0b4c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:45:39.640100 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-1dd56841-4477-424f-9f69-05476a9d047f None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:45:39.641395 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-1dd56841-4477-424f-9f69-05476a9d047f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:45:39.650979 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 578/1159] 10.222.0.18 () {58 vars in 958 bytes} [Tue Jul 26 15:45:39 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:45:39.653539 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-81d39b56-7545-4bcc-a002-c395fc0b4c3a None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:45:39.654763 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-81d39b56-7545-4bcc-a002-c395fc0b4c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:45:39.655658 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd56841-4477-424f-9f69-05476a9d047f None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:45:39.662960 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 582/1160] 10.222.0.18 () {58 vars in 958 bytes} [Tue Jul 26 15:45:39 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:45:39.665754 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd56841-4477-424f-9f69-05476a9d047f None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:45:39.667638 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d39b56-7545-4bcc-a002-c395fc0b4c3a None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:45:39.671242 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88433d7b-25e8-4975-9366-ee379a070d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1316e00006b74e70a667f12420c63a2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:45:39.671875 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88433d7b-25e8-4975-9366-ee379a070d2e admin admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:45:39.672416 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88433d7b-25e8-4975-9366-ee379a070d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:45:39.672689 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88433d7b-25e8-4975-9366-ee379a070d2e admin admin] PATH_INFO: `/v3/domains` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:45:39.673399 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88433d7b-25e8-4975-9366-ee379a070d2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:45:39.673709 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88433d7b-25e8-4975-9366-ee379a070d2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:45:39.675411 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88433d7b-25e8-4975-9366-ee379a070d2e admin admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:45:39.677516 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d39b56-7545-4bcc-a002-c395fc0b4c3a None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:45:39.682094 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb7f2f1-804a-4a7f-acad-050ce2492786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1316e00006b74e70a667f12420c63a2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:45:39.682721 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb7f2f1-804a-4a7f-acad-050ce2492786 admin admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:45:39.683000 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb7f2f1-804a-4a7f-acad-050ce2492786 admin admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:45:39.683301 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb7f2f1-804a-4a7f-acad-050ce2492786 admin admin] PATH_INFO: `/v3/domains` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:45:39.684227 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb7f2f1-804a-4a7f-acad-050ce2492786 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:45:39.684398 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb7f2f1-804a-4a7f-acad-050ce2492786 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:45:39.685337 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: WARNING py.warnings [None req-1eb7f2f1-804a-4a7f-acad-050ce2492786 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 15:45:39.685337 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: warnings.warn(msg) Jul 26 15:45:39.685337 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: Jul 26 15:45:39.686233 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb7f2f1-804a-4a7f-acad-050ce2492786 admin admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:45:39.688200 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 579/1161] 10.222.0.18 () {58 vars in 1153 bytes} [Tue Jul 26 15:45:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:45:39.696803 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88433d7b-25e8-4975-9366-ee379a070d2e admin admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:45:39.700966 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 583/1162] 10.222.0.18 () {58 vars in 1153 bytes} [Tue Jul 26 15:45:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:45:39.707305 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88433d7b-25e8-4975-9366-ee379a070d2e admin admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:45:39.710071 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb7f2f1-804a-4a7f-acad-050ce2492786 admin admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:45:39.714702 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa9ce37-b823-45fd-b762-ae345b957007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1316e00006b74e70a667f12420c63a2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:45:39.716064 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa9ce37-b823-45fd-b762-ae345b957007 admin admin] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:45:39.716349 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa9ce37-b823-45fd-b762-ae345b957007 admin admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:45:39.716629 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa9ce37-b823-45fd-b762-ae345b957007 admin admin] PATH_INFO: `/v3/projects` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:45:39.717312 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa9ce37-b823-45fd-b762-ae345b957007 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:45:39.718364 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: WARNING py.warnings [None req-6fa9ce37-b823-45fd-b762-ae345b957007 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 15:45:39.718364 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: warnings.warn(msg) Jul 26 15:45:39.718364 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: Jul 26 15:45:39.719626 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa9ce37-b823-45fd-b762-ae345b957007 admin admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:45:39.720376 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb7f2f1-804a-4a7f-acad-050ce2492786 admin admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:45:39.725100 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b2fe76-8f10-41fe-bafb-fe1b4230bea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1316e00006b74e70a667f12420c63a2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:45:39.725724 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2fe76-8f10-41fe-bafb-fe1b4230bea9 admin admin] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:45:39.726006 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2fe76-8f10-41fe-bafb-fe1b4230bea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:45:39.726283 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2fe76-8f10-41fe-bafb-fe1b4230bea9 admin admin] PATH_INFO: `/v3/projects` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:45:39.726966 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b2fe76-8f10-41fe-bafb-fe1b4230bea9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:45:39.728985 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b2fe76-8f10-41fe-bafb-fe1b4230bea9 admin admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:45:39.830327 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 580/1163] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Jul 26 15:45:39 2022] POST /identity/v3/projects => generated 385 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:45:39.835064 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa9ce37-b823-45fd-b762-ae345b957007 admin admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:45:39.860685 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 584/1164] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Jul 26 15:45:39 2022] POST /identity/v3/projects => generated 377 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:45:39.864971 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b2fe76-8f10-41fe-bafb-fe1b4230bea9 admin admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:45:39.900566 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa9ce37-b823-45fd-b762-ae345b957007 admin admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:45:39.933740 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b2fe76-8f10-41fe-bafb-fe1b4230bea9 admin admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:45:39.939588 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098a832c-f4dc-41a8-8931-668d3ed009c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1316e00006b74e70a667f12420c63a2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:45:39.940234 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a832c-f4dc-41a8-8931-668d3ed009c7 admin admin] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:45:39.940517 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a832c-f4dc-41a8-8931-668d3ed009c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:45:39.940792 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a832c-f4dc-41a8-8931-668d3ed009c7 admin admin] PATH_INFO: `/v3/users` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:45:39.941509 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098a832c-f4dc-41a8-8931-668d3ed009c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:45:39.943109 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: WARNING py.warnings [None req-098a832c-f4dc-41a8-8931-668d3ed009c7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 15:45:39.943109 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: warnings.warn(msg) Jul 26 15:45:39.943109 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: Jul 26 15:45:39.944408 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098a832c-f4dc-41a8-8931-668d3ed009c7 admin admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:45:39.960722 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05184bad-9013-42fc-ab2f-6893bec58ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1316e00006b74e70a667f12420c63a2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:45:39.961354 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05184bad-9013-42fc-ab2f-6893bec58ec0 admin admin] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:45:39.961799 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05184bad-9013-42fc-ab2f-6893bec58ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:45:39.961992 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05184bad-9013-42fc-ab2f-6893bec58ec0 admin admin] PATH_INFO: `/v3/users` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:45:39.962660 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05184bad-9013-42fc-ab2f-6893bec58ec0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:45:39.964700 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05184bad-9013-42fc-ab2f-6893bec58ec0 admin admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:45:40.046244 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 585/1165] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Jul 26 15:45:39 2022] POST /identity/v3/users => generated 289 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:45:40.050254 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098a832c-f4dc-41a8-8931-668d3ed009c7 admin admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:45:40.060658 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098a832c-f4dc-41a8-8931-668d3ed009c7 admin admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:45:40.065336 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29a617f-4b93-49eb-8a48-12b3835c5267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1316e00006b74e70a667f12420c63a2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:45:40.065945 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a617f-4b93-49eb-8a48-12b3835c5267 admin admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:45:40.066289 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a617f-4b93-49eb-8a48-12b3835c5267 admin admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:45:40.066574 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a617f-4b93-49eb-8a48-12b3835c5267 admin admin] PATH_INFO: `/v3/roles` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:45:40.067300 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29a617f-4b93-49eb-8a48-12b3835c5267 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:45:40.069541 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29a617f-4b93-49eb-8a48-12b3835c5267 admin admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:45:40.080776 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 586/1166] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Jul 26 15:45:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 15:45:40.080960 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 581/1167] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Jul 26 15:45:39 2022] POST /identity/v3/users => generated 293 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:45:40.086375 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29a617f-4b93-49eb-8a48-12b3835c5267 admin admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:45:40.086569 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05184bad-9013-42fc-ab2f-6893bec58ec0 admin admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:45:40.096424 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29a617f-4b93-49eb-8a48-12b3835c5267 admin admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:45:40.097476 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05184bad-9013-42fc-ab2f-6893bec58ec0 admin admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:45:40.101235 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0a695c-2fb5-4c05-9814-70ca0efc6512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1316e00006b74e70a667f12420c63a2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:45:40.101853 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a695c-2fb5-4c05-9814-70ca0efc6512 admin admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:45:40.102121 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9f74e0-f135-42cc-a772-6f4e3c24ecff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1316e00006b74e70a667f12420c63a2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:45:40.102251 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a695c-2fb5-4c05-9814-70ca0efc6512 admin admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:45:40.102394 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a695c-2fb5-4c05-9814-70ca0efc6512 admin admin] PATH_INFO: `/v3/roles` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:45:40.102744 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f74e0-f135-42cc-a772-6f4e3c24ecff admin admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:45:40.103025 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f74e0-f135-42cc-a772-6f4e3c24ecff admin admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:45:40.103163 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0a695c-2fb5-4c05-9814-70ca0efc6512 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:45:40.103353 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f74e0-f135-42cc-a772-6f4e3c24ecff admin admin] PATH_INFO: `/v3/roles` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:45:40.104044 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9f74e0-f135-42cc-a772-6f4e3c24ecff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:45:40.104724 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0a695c-2fb5-4c05-9814-70ca0efc6512 admin admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:45:40.105675 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9f74e0-f135-42cc-a772-6f4e3c24ecff admin admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:45:40.116172 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 587/1168] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Jul 26 15:45:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 15:45:40.116457 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 582/1169] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Jul 26 15:45:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:45:40.120349 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9f74e0-f135-42cc-a772-6f4e3c24ecff admin admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:45:40.120518 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0a695c-2fb5-4c05-9814-70ca0efc6512 admin admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:45:40.131108 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0a695c-2fb5-4c05-9814-70ca0efc6512 admin admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:45:40.131512 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9f74e0-f135-42cc-a772-6f4e3c24ecff admin admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:45:40.135769 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef7f3b-9352-4eb5-959d-7d324dfd020d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1316e00006b74e70a667f12420c63a2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:45:40.136447 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef7f3b-9352-4eb5-959d-7d324dfd020d admin admin] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:45:40.136662 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef7f3b-9352-4eb5-959d-7d324dfd020d admin admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:45:40.136957 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef7f3b-9352-4eb5-959d-7d324dfd020d admin admin] PATH_INFO: `/v3/roles` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:45:40.137201 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca98c312-e99b-4d98-a7a0-68a2b156227f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1316e00006b74e70a667f12420c63a2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:45:40.137646 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ef7f3b-9352-4eb5-959d-7d324dfd020d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:45:40.137882 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98c312-e99b-4d98-a7a0-68a2b156227f admin admin] REQUEST_METHOD: `PUT` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:45:40.138152 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98c312-e99b-4d98-a7a0-68a2b156227f admin admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:45:40.138434 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98c312-e99b-4d98-a7a0-68a2b156227f admin admin] PATH_INFO: `/v3/projects/f3159d30c6044f70a32c1ad37791a71c/users/aed3fe46c30a45629eddc49c90fa6c1e/roles/fd8f80bccab248edbb1d09ec187a8113` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:45:40.139265 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ef7f3b-9352-4eb5-959d-7d324dfd020d admin admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:45:40.150346 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 588/1170] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Jul 26 15:45:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:45:40.153624 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca98c312-e99b-4d98-a7a0-68a2b156227f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3159d30c6044f70a32c1ad37791a71c, user_id=aed3fe46c30a45629eddc49c90fa6c1e, role_id=fd8f80bccab248edbb1d09ec187a8113)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:45:40.154722 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef7f3b-9352-4eb5-959d-7d324dfd020d admin admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:45:40.154917 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: WARNING py.warnings [None req-ca98c312-e99b-4d98-a7a0-68a2b156227f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 15:45:40.154917 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: warnings.warn(msg) Jul 26 15:45:40.154917 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: Jul 26 15:45:40.156954 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca98c312-e99b-4d98-a7a0-68a2b156227f admin admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:45:40.165386 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef7f3b-9352-4eb5-959d-7d324dfd020d admin admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:45:40.170380 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127d30bf-c9bf-474d-a813-fbed845e550c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1316e00006b74e70a667f12420c63a2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:45:40.174792 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d30bf-c9bf-474d-a813-fbed845e550c admin admin] REQUEST_METHOD: `PUT` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:45:40.174792 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d30bf-c9bf-474d-a813-fbed845e550c admin admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:45:40.174792 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d30bf-c9bf-474d-a813-fbed845e550c admin admin] PATH_INFO: `/v3/projects/ab39c21f7d694e5d8d01f78e0efc318f/users/74b8ef44c6824726b1eb069c6930a87e/roles/fd8f80bccab248edbb1d09ec187a8113` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:45:40.187310 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127d30bf-c9bf-474d-a813-fbed845e550c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab39c21f7d694e5d8d01f78e0efc318f, user_id=74b8ef44c6824726b1eb069c6930a87e, role_id=fd8f80bccab248edbb1d09ec187a8113)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:45:40.190318 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127d30bf-c9bf-474d-a813-fbed845e550c admin admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:45:40.228935 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 583/1171] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Jul 26 15:45:40 2022] PUT /identity/v3/projects/f3159d30c6044f70a32c1ad37791a71c/users/aed3fe46c30a45629eddc49c90fa6c1e/roles/fd8f80bccab248edbb1d09ec187a8113 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:45:40.234342 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3321a4-8398-4712-ad59-e17a640cb677 None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:45:40.234627 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3321a4-8398-4712-ad59-e17a640cb677 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:45:40.234902 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3321a4-8398-4712-ad59-e17a640cb677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:45:40.257900 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-7b3321a4-8398-4712-ad59-e17a640cb677 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:45:40.258403 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 589/1172] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Jul 26 15:45:40 2022] PUT /identity/v3/projects/ab39c21f7d694e5d8d01f78e0efc318f/users/74b8ef44c6824726b1eb069c6930a87e/roles/fd8f80bccab248edbb1d09ec187a8113 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:45:40.263704 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-7b3321a4-8398-4712-ad59-e17a640cb677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:45:40.265180 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf81a51-732c-4967-a5ca-0175f686ae23 None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:45:40.265475 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf81a51-732c-4967-a5ca-0175f686ae23 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:45:40.265783 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf81a51-732c-4967-a5ca-0175f686ae23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:45:40.270895 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:45:40.284711 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-6bf81a51-732c-4967-a5ca-0175f686ae23 None None] MFA Rules not processed for user `18673fd27512449ab07302f33ac3c310`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:45:40.285969 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-6bf81a51-732c-4967-a5ca-0175f686ae23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:45:40.325063 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 584/1173] 10.222.0.18 () {58 vars in 958 bytes} [Tue Jul 26 15:45:40 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:45:40.330909 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:45:40.335999 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3321a4-8398-4712-ad59-e17a640cb677 None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:45:40.352793 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 590/1174] 10.222.0.18 () {58 vars in 958 bytes} [Tue Jul 26 15:45:40 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:45:40.363158 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf81a51-732c-4967-a5ca-0175f686ae23 None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:45:40.394451 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3321a4-8398-4712-ad59-e17a640cb677 None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:45:40.398219 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421fe610-b244-4013-bf5c-4cf6440bbcce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960c230d1e8841e6b231fdbf4d172cc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9178e468facc41d6a7d828dfcd5301b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:45:40.398850 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421fe610-b244-4013-bf5c-4cf6440bbcce service neutron] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:45:40.399152 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421fe610-b244-4013-bf5c-4cf6440bbcce service neutron] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:45:40.399444 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421fe610-b244-4013-bf5c-4cf6440bbcce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:45:40.408752 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421fe610-b244-4013-bf5c-4cf6440bbcce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:45:40.410231 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421fe610-b244-4013-bf5c-4cf6440bbcce service neutron] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:45:40.420137 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf81a51-732c-4967-a5ca-0175f686ae23 None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:45:40.420800 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 585/1175] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 15:45:40 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:45:40.423940 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977352cd-da4f-42e7-9546-6cb819992b96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960c230d1e8841e6b231fdbf4d172cc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9178e468facc41d6a7d828dfcd5301b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:45:40.424574 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977352cd-da4f-42e7-9546-6cb819992b96 service neutron] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:45:40.424862 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977352cd-da4f-42e7-9546-6cb819992b96 service neutron] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:45:40.425142 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977352cd-da4f-42e7-9546-6cb819992b96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:45:40.436952 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977352cd-da4f-42e7-9546-6cb819992b96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:45:40.439313 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977352cd-da4f-42e7-9546-6cb819992b96 service neutron] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:45:40.451805 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 591/1176] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 15:45:40 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:45:47.033475 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b6e51-1d09-4fae-944d-2a56c84de02a None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:45:47.033988 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b6e51-1d09-4fae-944d-2a56c84de02a None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:45:47.033988 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b6e51-1d09-4fae-944d-2a56c84de02a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:45:47.095689 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-7f9b6e51-1d09-4fae-944d-2a56c84de02a None None] MFA Rules not processed for user `aed3fe46c30a45629eddc49c90fa6c1e`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:45:47.096972 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-7f9b6e51-1d09-4fae-944d-2a56c84de02a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:45:47.193781 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 586/1177] 10.222.0.18 () {58 vars in 958 bytes} [Tue Jul 26 15:45:47 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:45:47.199179 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977352cd-da4f-42e7-9546-6cb819992b96 service neutron] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:45:47.209742 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977352cd-da4f-42e7-9546-6cb819992b96 service neutron] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:45:47.215299 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ca2ab4-c9ef-4d35-8ab4-b8abc2d492a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1316e00006b74e70a667f12420c63a2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:45:47.215942 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca2ab4-c9ef-4d35-8ab4-b8abc2d492a5 admin admin] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:45:47.216226 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca2ab4-c9ef-4d35-8ab4-b8abc2d492a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:45:47.216503 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca2ab4-c9ef-4d35-8ab4-b8abc2d492a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:45:47.217190 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ca2ab4-c9ef-4d35-8ab4-b8abc2d492a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:45:47.219152 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ca2ab4-c9ef-4d35-8ab4-b8abc2d492a5 admin admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:45:47.329184 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 592/1178] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Jul 26 15:45:47 2022] POST /identity/v3/projects => generated 371 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:45:47.330214 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9b6e51-1d09-4fae-944d-2a56c84de02a None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:45:47.351617 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9b6e51-1d09-4fae-944d-2a56c84de02a None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:45:47.423636 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:45:47.447543 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e5a2e2-4622-4fe7-8639-d1f3b13f1b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1316e00006b74e70a667f12420c63a2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:45:47.452721 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5a2e2-4622-4fe7-8639-d1f3b13f1b52 admin admin] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:45:47.453189 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5a2e2-4622-4fe7-8639-d1f3b13f1b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:45:47.453549 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5a2e2-4622-4fe7-8639-d1f3b13f1b52 admin admin] PATH_INFO: `/v3/users` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:45:47.454401 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e5a2e2-4622-4fe7-8639-d1f3b13f1b52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:45:47.456590 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e5a2e2-4622-4fe7-8639-d1f3b13f1b52 admin admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:45:47.615669 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae4530-2d4c-491e-82ee-9480598180e4 None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:45:47.616045 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae4530-2d4c-491e-82ee-9480598180e4 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:45:47.616395 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae4530-2d4c-491e-82ee-9480598180e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:45:47.619937 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 587/1179] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Jul 26 15:45:47 2022] POST /identity/v3/users => generated 292 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:45:47.624108 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e5a2e2-4622-4fe7-8639-d1f3b13f1b52 admin admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:45:47.637571 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e5a2e2-4622-4fe7-8639-d1f3b13f1b52 admin admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:45:47.642499 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539fa5cd-70b3-4532-b31e-9f428565798a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1316e00006b74e70a667f12420c63a2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:45:47.643570 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539fa5cd-70b3-4532-b31e-9f428565798a admin admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:45:47.643570 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539fa5cd-70b3-4532-b31e-9f428565798a admin admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:45:47.643814 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539fa5cd-70b3-4532-b31e-9f428565798a admin admin] PATH_INFO: `/v3/roles` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:45:47.644506 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539fa5cd-70b3-4532-b31e-9f428565798a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:45:47.646446 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539fa5cd-70b3-4532-b31e-9f428565798a admin admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:45:47.657434 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-5fae4530-2d4c-491e-82ee-9480598180e4 None None] MFA Rules not processed for user `74b8ef44c6824726b1eb069c6930a87e`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:45:47.658675 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-5fae4530-2d4c-491e-82ee-9480598180e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:45:47.664804 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 588/1180] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Jul 26 15:45:47 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 15:45:47.668910 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539fa5cd-70b3-4532-b31e-9f428565798a admin admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:45:47.681730 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539fa5cd-70b3-4532-b31e-9f428565798a admin admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:45:47.693330 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ecd5a3-1f22-4286-840e-f056ea85af65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1316e00006b74e70a667f12420c63a2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:45:47.696526 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ecd5a3-1f22-4286-840e-f056ea85af65 admin admin] REQUEST_METHOD: `PUT` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:45:47.696814 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ecd5a3-1f22-4286-840e-f056ea85af65 admin admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:45:47.697124 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ecd5a3-1f22-4286-840e-f056ea85af65 admin admin] PATH_INFO: `/v3/projects/0d3c7307025f4027807d52b5946c973c/users/29c655c68dbc49e9b5a6ca4ab460f40b/roles/2c659645e15c4204b1457556939397cb` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:45:47.717373 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ecd5a3-1f22-4286-840e-f056ea85af65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d3c7307025f4027807d52b5946c973c, user_id=29c655c68dbc49e9b5a6ca4ab460f40b, role_id=2c659645e15c4204b1457556939397cb)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:45:47.726520 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ecd5a3-1f22-4286-840e-f056ea85af65 admin admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:45:47.752730 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 593/1181] 10.222.0.18 () {58 vars in 958 bytes} [Tue Jul 26 15:45:47 2022] POST /identity/v3/auth/tokens => generated 2812 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:45:47.760502 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fae4530-2d4c-491e-82ee-9480598180e4 None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:45:47.774080 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fae4530-2d4c-491e-82ee-9480598180e4 None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:45:47.785858 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b415c068-ba5c-43f2-b7bf-b93b14abb37f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1316e00006b74e70a667f12420c63a2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:45:47.786565 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b415c068-ba5c-43f2-b7bf-b93b14abb37f admin admin] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:45:47.786945 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b415c068-ba5c-43f2-b7bf-b93b14abb37f admin admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:45:47.787237 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b415c068-ba5c-43f2-b7bf-b93b14abb37f admin admin] PATH_INFO: `/v3/projects` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:45:47.795593 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b415c068-ba5c-43f2-b7bf-b93b14abb37f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:45:47.795593 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b415c068-ba5c-43f2-b7bf-b93b14abb37f admin admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:45:47.859785 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 589/1182] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Jul 26 15:45:47 2022] PUT /identity/v3/projects/0d3c7307025f4027807d52b5946c973c/users/29c655c68dbc49e9b5a6ca4ab460f40b/roles/2c659645e15c4204b1457556939397cb => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:45:47.863739 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ecd5a3-1f22-4286-840e-f056ea85af65 admin admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:45:47.940803 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 594/1183] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Jul 26 15:45:47 2022] POST /identity/v3/projects => generated 385 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:45:47.945952 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b415c068-ba5c-43f2-b7bf-b93b14abb37f admin admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:45:47.962723 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ecd5a3-1f22-4286-840e-f056ea85af65 admin admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:45:48.039656 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:45:48.085203 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b415c068-ba5c-43f2-b7bf-b93b14abb37f admin admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:45:48.095010 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d99031-d61f-4275-9786-ced5a82dac51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1316e00006b74e70a667f12420c63a2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:45:48.098306 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d99031-d61f-4275-9786-ced5a82dac51 admin admin] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:45:48.098306 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d99031-d61f-4275-9786-ced5a82dac51 admin admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:45:48.098306 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d99031-d61f-4275-9786-ced5a82dac51 admin admin] PATH_INFO: `/v3/users` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:45:48.098306 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d99031-d61f-4275-9786-ced5a82dac51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:45:48.101983 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d99031-d61f-4275-9786-ced5a82dac51 admin admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:45:48.120203 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30154ef-1903-4472-9018-33c6895cb9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1316e00006b74e70a667f12420c63a2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:45:48.121555 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30154ef-1903-4472-9018-33c6895cb9ff admin admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:45:48.126826 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30154ef-1903-4472-9018-33c6895cb9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:45:48.126826 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30154ef-1903-4472-9018-33c6895cb9ff admin admin] PATH_INFO: `/v3/roles` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:45:48.126826 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30154ef-1903-4472-9018-33c6895cb9ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:45:48.126826 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30154ef-1903-4472-9018-33c6895cb9ff admin admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:45:48.143813 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 590/1184] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Jul 26 15:45:47 2022] GET /identity/v3/roles => generated 1420 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 15:45:48.144880 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30154ef-1903-4472-9018-33c6895cb9ff admin admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:45:48.157263 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30154ef-1903-4472-9018-33c6895cb9ff admin admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:45:48.163579 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec4c5d3-ad6c-461f-9aa3-dc9cd205cae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1316e00006b74e70a667f12420c63a2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:45:48.164352 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec4c5d3-ad6c-461f-9aa3-dc9cd205cae0 admin admin] REQUEST_METHOD: `PUT` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:45:48.164669 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec4c5d3-ad6c-461f-9aa3-dc9cd205cae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:45:48.164935 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec4c5d3-ad6c-461f-9aa3-dc9cd205cae0 admin admin] PATH_INFO: `/v3/projects/0d3c7307025f4027807d52b5946c973c/users/29c655c68dbc49e9b5a6ca4ab460f40b/roles/2c659645e15c4204b1457556939397cb` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:45:48.167096 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec4c5d3-ad6c-461f-9aa3-dc9cd205cae0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d3c7307025f4027807d52b5946c973c, user_id=29c655c68dbc49e9b5a6ca4ab460f40b, role_id=2c659645e15c4204b1457556939397cb)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:45:48.170478 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec4c5d3-ad6c-461f-9aa3-dc9cd205cae0 admin admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:45:48.185342 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 591/1185] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Jul 26 15:45:48 2022] PUT /identity/v3/projects/0d3c7307025f4027807d52b5946c973c/users/29c655c68dbc49e9b5a6ca4ab460f40b/roles/2c659645e15c4204b1457556939397cb => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:45:48.210730 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 595/1186] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Jul 26 15:45:47 2022] POST /identity/v3/users => generated 299 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:45:48.211723 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec4c5d3-ad6c-461f-9aa3-dc9cd205cae0 admin admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:45:48.254825 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:45:48.311091 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec4c5d3-ad6c-461f-9aa3-dc9cd205cae0 admin admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:45:48.326026 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13ebde6-bf5b-49f6-8fd9-cce284e0578c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1316e00006b74e70a667f12420c63a2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:45:48.326858 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ebde6-bf5b-49f6-8fd9-cce284e0578c admin admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:45:48.327395 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ebde6-bf5b-49f6-8fd9-cce284e0578c admin admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:45:48.327719 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ebde6-bf5b-49f6-8fd9-cce284e0578c admin admin] PATH_INFO: `/v3/roles` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:45:48.328540 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13ebde6-bf5b-49f6-8fd9-cce284e0578c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:45:48.330507 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13ebde6-bf5b-49f6-8fd9-cce284e0578c admin admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:45:48.344475 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 592/1187] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Jul 26 15:45:48 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:45:48.349589 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d99031-d61f-4275-9786-ced5a82dac51 admin admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:45:48.360997 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d99031-d61f-4275-9786-ced5a82dac51 admin admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:45:48.367225 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f77862-3bc6-4a5f-9c9f-406b31bef13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1316e00006b74e70a667f12420c63a2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:45:48.373690 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f77862-3bc6-4a5f-9c9f-406b31bef13a admin admin] REQUEST_METHOD: `PUT` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:45:48.373690 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f77862-3bc6-4a5f-9c9f-406b31bef13a admin admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:45:48.373690 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f77862-3bc6-4a5f-9c9f-406b31bef13a admin admin] PATH_INFO: `/v3/projects/f1341afbea16426c9c2e13f4f5ce9fcf/users/b38d0ada7b554dbe845f1f00ae464bc3/roles/2c659645e15c4204b1457556939397cb` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:45:48.395208 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f77862-3bc6-4a5f-9c9f-406b31bef13a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1341afbea16426c9c2e13f4f5ce9fcf, user_id=b38d0ada7b554dbe845f1f00ae464bc3, role_id=2c659645e15c4204b1457556939397cb)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:45:48.400261 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f77862-3bc6-4a5f-9c9f-406b31bef13a admin admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:45:48.483257 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 596/1188] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Jul 26 15:45:48 2022] PUT /identity/v3/projects/f1341afbea16426c9c2e13f4f5ce9fcf/users/b38d0ada7b554dbe845f1f00ae464bc3/roles/2c659645e15c4204b1457556939397cb => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:45:48.488749 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13ebde6-bf5b-49f6-8fd9-cce284e0578c admin admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:45:48.498893 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13ebde6-bf5b-49f6-8fd9-cce284e0578c admin admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:45:48.617043 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b598c9-c6af-416d-a923-5dfb30b65c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1316e00006b74e70a667f12420c63a2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:45:48.618105 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b598c9-c6af-416d-a923-5dfb30b65c6b admin admin] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:45:48.618105 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b598c9-c6af-416d-a923-5dfb30b65c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:45:48.618323 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b598c9-c6af-416d-a923-5dfb30b65c6b admin admin] PATH_INFO: `/v3/roles` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:45:48.618870 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b598c9-c6af-416d-a923-5dfb30b65c6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:45:48.620620 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b598c9-c6af-416d-a923-5dfb30b65c6b admin admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:45:48.651740 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 593/1189] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Jul 26 15:45:48 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:45:48.651981 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f77862-3bc6-4a5f-9c9f-406b31bef13a admin admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:45:48.678067 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f77862-3bc6-4a5f-9c9f-406b31bef13a admin admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:45:48.686818 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c2cecf-6c9b-4578-a0ac-eecce9f75bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1316e00006b74e70a667f12420c63a2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:45:48.687760 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c2cecf-6c9b-4578-a0ac-eecce9f75bfb admin admin] REQUEST_METHOD: `PUT` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:45:48.689772 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c2cecf-6c9b-4578-a0ac-eecce9f75bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:45:48.689772 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c2cecf-6c9b-4578-a0ac-eecce9f75bfb admin admin] PATH_INFO: `/v3/projects/f1341afbea16426c9c2e13f4f5ce9fcf/users/b38d0ada7b554dbe845f1f00ae464bc3/roles/2c659645e15c4204b1457556939397cb` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:45:48.692767 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c2cecf-6c9b-4578-a0ac-eecce9f75bfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1341afbea16426c9c2e13f4f5ce9fcf, user_id=b38d0ada7b554dbe845f1f00ae464bc3, role_id=2c659645e15c4204b1457556939397cb)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:45:48.695973 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c2cecf-6c9b-4578-a0ac-eecce9f75bfb admin admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:45:48.713824 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 597/1190] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Jul 26 15:45:48 2022] PUT /identity/v3/projects/f1341afbea16426c9c2e13f4f5ce9fcf/users/b38d0ada7b554dbe845f1f00ae464bc3/roles/2c659645e15c4204b1457556939397cb => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:45:56.647760 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521ef4b-91a0-401a-b814-3dbddefd2531 None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:45:56.648279 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521ef4b-91a0-401a-b814-3dbddefd2531 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:45:56.648279 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521ef4b-91a0-401a-b814-3dbddefd2531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:45:56.685057 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-8521ef4b-91a0-401a-b814-3dbddefd2531 None None] MFA Rules not processed for user `29c655c68dbc49e9b5a6ca4ab460f40b`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:45:56.687176 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-8521ef4b-91a0-401a-b814-3dbddefd2531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:45:56.809811 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 594/1191] 10.222.0.18 () {58 vars in 958 bytes} [Tue Jul 26 15:45:56 2022] POST /identity/v3/auth/tokens => generated 2865 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:45:56.824703 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c2cecf-6c9b-4578-a0ac-eecce9f75bfb admin admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:45:56.828206 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-27c2cecf-6c9b-4578-a0ac-eecce9f75bfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:45:56.928437 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c2cecf-6c9b-4578-a0ac-eecce9f75bfb admin admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:45:56.936942 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaba9c1-c7c7-4f83-b3f4-6eeb3dc07879 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd903ca1082154ef2bfac7156d22ddac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9178e468facc41d6a7d828dfcd5301b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:45:56.937837 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaba9c1-c7c7-4f83-b3f4-6eeb3dc07879 service glance] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:45:56.938300 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaba9c1-c7c7-4f83-b3f4-6eeb3dc07879 service glance] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:45:56.938732 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaba9c1-c7c7-4f83-b3f4-6eeb3dc07879 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:45:57.058056 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaba9c1-c7c7-4f83-b3f4-6eeb3dc07879 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:45:57.059866 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaba9c1-c7c7-4f83-b3f4-6eeb3dc07879 service glance] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:45:57.072925 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 598/1192] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 15:45:56 2022] GET /identity/v3/auth/tokens => generated 2804 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:45:57.532077 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0124c1-fed2-42d8-8a6e-b346080c33f3 None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:45:57.532517 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0124c1-fed2-42d8-8a6e-b346080c33f3 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:45:57.534453 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0124c1-fed2-42d8-8a6e-b346080c33f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:45:57.584707 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-9e0124c1-fed2-42d8-8a6e-b346080c33f3 None None] MFA Rules not processed for user `b38d0ada7b554dbe845f1f00ae464bc3`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:45:57.586752 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-9e0124c1-fed2-42d8-8a6e-b346080c33f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:45:57.652827 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=100 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:45:57.701489 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 595/1193] 10.222.0.18 () {58 vars in 958 bytes} [Tue Jul 26 15:45:57 2022] POST /identity/v3/auth/tokens => generated 2879 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:45:57.714235 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaba9c1-c7c7-4f83-b3f4-6eeb3dc07879 service glance] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:45:57.715877 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-ceaba9c1-c7c7-4f83-b3f4-6eeb3dc07879 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:45:57.731671 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaba9c1-c7c7-4f83-b3f4-6eeb3dc07879 service glance] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:45:57.743452 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b5cdf7-4009-44b2-85f1-6480186c6bb6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd903ca1082154ef2bfac7156d22ddac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9178e468facc41d6a7d828dfcd5301b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:45:57.744595 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b5cdf7-4009-44b2-85f1-6480186c6bb6 service glance] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:45:57.744595 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b5cdf7-4009-44b2-85f1-6480186c6bb6 service glance] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:45:57.744903 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b5cdf7-4009-44b2-85f1-6480186c6bb6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:45:57.802128 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:45:57.837576 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b5cdf7-4009-44b2-85f1-6480186c6bb6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:45:57.840868 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b5cdf7-4009-44b2-85f1-6480186c6bb6 service glance] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:45:57.856359 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 599/1194] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 15:45:57 2022] GET /identity/v3/auth/tokens => generated 2812 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:46:07.710069 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=12 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:46:07.914207 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=10 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:46:08.806593 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75fc049-e44c-4acb-9d05-73dc799a61de None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:46:08.807522 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75fc049-e44c-4acb-9d05-73dc799a61de None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:46:08.807522 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75fc049-e44c-4acb-9d05-73dc799a61de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:46:08.830812 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-c75fc049-e44c-4acb-9d05-73dc799a61de None None] MFA Rules not processed for user `74b8ef44c6824726b1eb069c6930a87e`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:46:08.832241 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-c75fc049-e44c-4acb-9d05-73dc799a61de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:46:08.840264 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 596/1195] 10.222.0.18 () {58 vars in 958 bytes} [Tue Jul 26 15:46:08 2022] POST /identity/v3/auth/tokens => generated 2812 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:46:09.148011 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7345210a-5556-47c0-a049-524cacf7ad3c None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:46:09.148011 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7345210a-5556-47c0-a049-524cacf7ad3c None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:46:09.148011 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7345210a-5556-47c0-a049-524cacf7ad3c None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:46:09.149717 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 600/1196] 10.222.0.18 () {54 vars in 962 bytes} [Tue Jul 26 15:46:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:46:09.156165 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0baf0e-62be-4586-8e96-052ec2e2d9e1 None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:46:09.156165 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0baf0e-62be-4586-8e96-052ec2e2d9e1 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:46:09.156165 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0baf0e-62be-4586-8e96-052ec2e2d9e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:46:09.182797 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-ab0baf0e-62be-4586-8e96-052ec2e2d9e1 None None] MFA Rules not processed for user `fbc5f2b36d3f45f1b3c8155e46c46fda`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:46:09.184131 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-ab0baf0e-62be-4586-8e96-052ec2e2d9e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:46:09.269627 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 597/1197] 10.222.0.18 () {58 vars in 1059 bytes} [Tue Jul 26 15:46:09 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:46:09.275512 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3dbb6c-318e-4893-b6e3-20485119fb19 None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:46:09.275812 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3dbb6c-318e-4893-b6e3-20485119fb19 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:46:09.276093 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3dbb6c-318e-4893-b6e3-20485119fb19 None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:46:09.277544 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 601/1198] 10.222.0.18 () {54 vars in 912 bytes} [Tue Jul 26 15:46:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:46:09.284992 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acbc7fb-1941-46c9-af88-31c97cef6e5c None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:46:09.285286 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acbc7fb-1941-46c9-af88-31c97cef6e5c None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:46:09.285611 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acbc7fb-1941-46c9-af88-31c97cef6e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:46:09.309561 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-0acbc7fb-1941-46c9-af88-31c97cef6e5c None None] MFA Rules not processed for user `fbc5f2b36d3f45f1b3c8155e46c46fda`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:46:09.310817 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-0acbc7fb-1941-46c9-af88-31c97cef6e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:46:09.325495 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 598/1199] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Jul 26 15:46:09 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:46:09.333241 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3dbb6c-318e-4893-b6e3-20485119fb19 None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:46:09.346909 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3dbb6c-318e-4893-b6e3-20485119fb19 None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:46:09.354602 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5c608f-4a51-4ab2-83df-54a2fff355a6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd903ca1082154ef2bfac7156d22ddac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9178e468facc41d6a7d828dfcd5301b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:46:09.354602 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c608f-4a51-4ab2-83df-54a2fff355a6 service glance] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:46:09.354602 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c608f-4a51-4ab2-83df-54a2fff355a6 service glance] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:46:09.354602 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c608f-4a51-4ab2-83df-54a2fff355a6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:46:09.368110 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5c608f-4a51-4ab2-83df-54a2fff355a6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:46:09.369893 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5c608f-4a51-4ab2-83df-54a2fff355a6 service glance] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:46:09.384112 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 602/1200] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 15:46:09 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:46:09.764763 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22272226-e480-4bf3-89ee-6909b71b7c15 None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:46:09.765079 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22272226-e480-4bf3-89ee-6909b71b7c15 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:46:09.765304 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22272226-e480-4bf3-89ee-6909b71b7c15 None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:46:09.766695 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 599/1201] 10.222.0.18 () {54 vars in 912 bytes} [Tue Jul 26 15:46:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:46:09.772961 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dbe73d-e667-434c-9363-02e3f76a2b0f None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:46:09.773250 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dbe73d-e667-434c-9363-02e3f76a2b0f None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:46:09.773533 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dbe73d-e667-434c-9363-02e3f76a2b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:46:09.794282 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-14dbe73d-e667-434c-9363-02e3f76a2b0f None None] MFA Rules not processed for user `960c230d1e8841e6b231fdbf4d172cc6`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:46:09.795803 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-14dbe73d-e667-434c-9363-02e3f76a2b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:46:09.854744 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 603/1202] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Jul 26 15:46:09 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:46:09.870140 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22272226-e480-4bf3-89ee-6909b71b7c15 None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:46:09.887683 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22272226-e480-4bf3-89ee-6909b71b7c15 None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:46:09.892273 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e53b4-2320-4bda-b929-929edcee2cae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960c230d1e8841e6b231fdbf4d172cc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9178e468facc41d6a7d828dfcd5301b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:46:09.893078 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e53b4-2320-4bda-b929-929edcee2cae service neutron] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:46:09.893553 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e53b4-2320-4bda-b929-929edcee2cae service neutron] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:46:09.893965 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e53b4-2320-4bda-b929-929edcee2cae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:46:09.907054 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964e53b4-2320-4bda-b929-929edcee2cae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:46:09.909769 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964e53b4-2320-4bda-b929-929edcee2cae service neutron] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:46:09.927516 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 600/1203] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 15:46:09 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:46:10.436666 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d576ee4c-eaf6-46e0-8eb6-d2ef45d8065b None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:46:10.437390 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d576ee4c-eaf6-46e0-8eb6-d2ef45d8065b None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:46:10.437390 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d576ee4c-eaf6-46e0-8eb6-d2ef45d8065b None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:46:10.438632 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 604/1204] 10.222.0.18 () {54 vars in 962 bytes} [Tue Jul 26 15:46:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 15:46:10.445112 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5b2a8-b522-4d04-98f2-3376fb5cf7f7 None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:46:10.445406 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5b2a8-b522-4d04-98f2-3376fb5cf7f7 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:46:10.445681 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5b2a8-b522-4d04-98f2-3376fb5cf7f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:46:10.473096 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-4fc5b2a8-b522-4d04-98f2-3376fb5cf7f7 None None] MFA Rules not processed for user `fbc5f2b36d3f45f1b3c8155e46c46fda`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:46:10.474362 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-4fc5b2a8-b522-4d04-98f2-3376fb5cf7f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:46:10.486226 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 601/1205] 10.222.0.18 () {58 vars in 1059 bytes} [Tue Jul 26 15:46:10 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:46:10.489935 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde0fb7-ff7b-43e9-a250-5a4ae7d3d802 None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:46:10.490220 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde0fb7-ff7b-43e9-a250-5a4ae7d3d802 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:46:10.491068 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde0fb7-ff7b-43e9-a250-5a4ae7d3d802 None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:46:10.492477 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 605/1206] 10.222.0.18 () {54 vars in 961 bytes} [Tue Jul 26 15:46:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 15:46:10.495688 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96014e55-3513-4207-8015-397472a93731 None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:46:10.499090 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96014e55-3513-4207-8015-397472a93731 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:46:10.499090 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96014e55-3513-4207-8015-397472a93731 None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:46:10.499090 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 602/1207] 10.222.0.18 () {54 vars in 912 bytes} [Tue Jul 26 15:46:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:46:10.499452 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de9d15e-a4d6-400d-99e4-e2f7071e7412 None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:46:10.499697 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de9d15e-a4d6-400d-99e4-e2f7071e7412 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:46:10.500070 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de9d15e-a4d6-400d-99e4-e2f7071e7412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:46:10.503291 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3547402e-32f3-40bb-84df-58272ff57b30 None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:46:10.503644 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3547402e-32f3-40bb-84df-58272ff57b30 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:46:10.504090 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3547402e-32f3-40bb-84df-58272ff57b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:46:10.528240 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-3547402e-32f3-40bb-84df-58272ff57b30 None None] MFA Rules not processed for user `fbc5f2b36d3f45f1b3c8155e46c46fda`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:46:10.529777 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-3547402e-32f3-40bb-84df-58272ff57b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:46:10.532987 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-9de9d15e-a4d6-400d-99e4-e2f7071e7412 None None] MFA Rules not processed for user `21a7f59ebf1b40a1b76ee2002ae38230`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:46:10.534190 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-9de9d15e-a4d6-400d-99e4-e2f7071e7412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:46:10.541840 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 603/1208] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Jul 26 15:46:10 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:46:10.555503 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3547402e-32f3-40bb-84df-58272ff57b30 None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:46:10.569322 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3547402e-32f3-40bb-84df-58272ff57b30 None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:46:10.574398 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeed9de-dce2-4722-8d21-bf5d29b81857 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960c230d1e8841e6b231fdbf4d172cc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9178e468facc41d6a7d828dfcd5301b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:46:10.575081 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeed9de-dce2-4722-8d21-bf5d29b81857 service neutron] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:46:10.575410 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeed9de-dce2-4722-8d21-bf5d29b81857 service neutron] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:46:10.576332 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeed9de-dce2-4722-8d21-bf5d29b81857 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:46:10.589729 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeed9de-dce2-4722-8d21-bf5d29b81857 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:46:10.591269 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeed9de-dce2-4722-8d21-bf5d29b81857 service neutron] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:46:10.604429 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 604/1209] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 15:46:10 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:46:10.632324 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 606/1210] 10.222.0.18 () {58 vars in 1058 bytes} [Tue Jul 26 15:46:10 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:46:10.641957 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeed9de-dce2-4722-8d21-bf5d29b81857 service neutron] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:46:10.655014 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeed9de-dce2-4722-8d21-bf5d29b81857 service neutron] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:46:10.661277 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0d57a5-386f-4194-9f64-379475dc34b3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21a7f59ebf1b40a1b76ee2002ae38230', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9178e468facc41d6a7d828dfcd5301b4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:46:10.661917 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d57a5-386f-4194-9f64-379475dc34b3 service placement] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:46:10.662203 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d57a5-386f-4194-9f64-379475dc34b3 service placement] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:46:10.662484 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d57a5-386f-4194-9f64-379475dc34b3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:46:10.665066 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-df0d57a5-386f-4194-9f64-379475dc34b3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:46:10.685108 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0d57a5-386f-4194-9f64-379475dc34b3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:46:10.686164 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0d57a5-386f-4194-9f64-379475dc34b3 service placement] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:46:10.700582 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 605/1211] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 15:46:10 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:46:20.620746 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=58 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:46:20.695429 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=59 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:46:22.589913 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4822e-d8d8-45e4-bd71-b0c79ae5c8c3 None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:46:22.590468 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4822e-d8d8-45e4-bd71-b0c79ae5c8c3 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:46:22.590468 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4822e-d8d8-45e4-bd71-b0c79ae5c8c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:46:22.612421 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-78b4822e-d8d8-45e4-bd71-b0c79ae5c8c3 None None] MFA Rules not processed for user `960c230d1e8841e6b231fdbf4d172cc6`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:46:22.614326 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-78b4822e-d8d8-45e4-bd71-b0c79ae5c8c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:46:22.621700 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 607/1212] 10.222.0.109 () {58 vars in 1016 bytes} [Tue Jul 26 15:46:22 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:46:22.632955 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0d57a5-386f-4194-9f64-379475dc34b3 service placement] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:46:22.642929 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0d57a5-386f-4194-9f64-379475dc34b3 service placement] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:46:22.646831 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd412243-ad0d-42ad-8ba0-daea56b1badc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960c230d1e8841e6b231fdbf4d172cc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9178e468facc41d6a7d828dfcd5301b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:46:22.647486 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd412243-ad0d-42ad-8ba0-daea56b1badc service neutron] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:46:22.647773 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd412243-ad0d-42ad-8ba0-daea56b1badc service neutron] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:46:22.648053 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd412243-ad0d-42ad-8ba0-daea56b1badc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:46:22.656365 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd412243-ad0d-42ad-8ba0-daea56b1badc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:46:22.657957 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd412243-ad0d-42ad-8ba0-daea56b1badc service neutron] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:46:22.667921 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 606/1213] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 15:46:22 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:46:23.742763 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc27e8-02e5-4180-a862-d9e2e176c12b None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:46:23.742763 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc27e8-02e5-4180-a862-d9e2e176c12b None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:46:23.745036 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc27e8-02e5-4180-a862-d9e2e176c12b None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:46:23.745375 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 608/1214] 10.222.0.18 () {54 vars in 921 bytes} [Tue Jul 26 15:46:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:46:23.758819 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa224d-0772-47f8-b2b2-03f7e71b3233 None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:46:23.758819 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa224d-0772-47f8-b2b2-03f7e71b3233 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:46:23.766494 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa224d-0772-47f8-b2b2-03f7e71b3233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:46:23.799429 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-b9aa224d-0772-47f8-b2b2-03f7e71b3233 None None] MFA Rules not processed for user `fbc5f2b36d3f45f1b3c8155e46c46fda`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:46:23.802557 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-b9aa224d-0772-47f8-b2b2-03f7e71b3233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:46:23.816135 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 607/1215] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Jul 26 15:46:23 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:46:23.852767 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bc27e8-02e5-4180-a862-d9e2e176c12b None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:46:23.869659 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bc27e8-02e5-4180-a862-d9e2e176c12b None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:46:23.881914 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cea478c-9f46-4cf2-a0c2-e2649ac0b7a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc5f2b36d3f45f1b3c8155e46c46fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9178e468facc41d6a7d828dfcd5301b4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:46:23.882891 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea478c-9f46-4cf2-a0c2-e2649ac0b7a1 service nova] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:46:23.883398 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea478c-9f46-4cf2-a0c2-e2649ac0b7a1 service nova] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:46:23.883925 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea478c-9f46-4cf2-a0c2-e2649ac0b7a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:46:23.898690 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cea478c-9f46-4cf2-a0c2-e2649ac0b7a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:46:23.900972 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cea478c-9f46-4cf2-a0c2-e2649ac0b7a1 service nova] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:46:23.916244 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 609/1216] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 15:46:23 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:46:30.074734 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e8a94-cff6-49ef-9daf-a906de86f71b None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:46:30.212100 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e8a94-cff6-49ef-9daf-a906de86f71b None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:46:30.212100 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e8a94-cff6-49ef-9daf-a906de86f71b None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:46:30.212100 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 608/1217] 10.222.0.18 () {54 vars in 921 bytes} [Tue Jul 26 15:46:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:46:30.213628 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094831bd-0a36-46d4-a8b0-a97730f3c3dc None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:46:30.213628 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094831bd-0a36-46d4-a8b0-a97730f3c3dc None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:46:30.213628 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094831bd-0a36-46d4-a8b0-a97730f3c3dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:46:30.213628 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-094831bd-0a36-46d4-a8b0-a97730f3c3dc None None] MFA Rules not processed for user `fbc5f2b36d3f45f1b3c8155e46c46fda`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:46:30.213628 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-094831bd-0a36-46d4-a8b0-a97730f3c3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:46:30.213628 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 610/1218] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Jul 26 15:46:30 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:46:30.214729 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e8a94-cff6-49ef-9daf-a906de86f71b None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:46:30.214729 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e8a94-cff6-49ef-9daf-a906de86f71b None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:46:30.214729 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c2affb-4f0e-465f-ae19-462600df676a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc5f2b36d3f45f1b3c8155e46c46fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9178e468facc41d6a7d828dfcd5301b4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:46:30.214729 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c2affb-4f0e-465f-ae19-462600df676a service nova] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:46:30.215904 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c2affb-4f0e-465f-ae19-462600df676a service nova] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:46:30.215904 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c2affb-4f0e-465f-ae19-462600df676a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:46:30.215904 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c2affb-4f0e-465f-ae19-462600df676a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:46:30.215904 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c2affb-4f0e-465f-ae19-462600df676a service nova] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:46:30.215904 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 609/1219] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 15:46:30 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:46:40.102475 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=12 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:46:40.173138 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=15 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:46:48.633519 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094831bd-0a36-46d4-a8b0-a97730f3c3dc None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:46:48.644736 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094831bd-0a36-46d4-a8b0-a97730f3c3dc None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:46:48.648616 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f133142-31bc-4dea-ae0f-49352c741167 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960c230d1e8841e6b231fdbf4d172cc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9178e468facc41d6a7d828dfcd5301b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:46:48.649315 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f133142-31bc-4dea-ae0f-49352c741167 service neutron] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:46:48.650184 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f133142-31bc-4dea-ae0f-49352c741167 service neutron] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:46:48.650184 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f133142-31bc-4dea-ae0f-49352c741167 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:46:48.661253 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f133142-31bc-4dea-ae0f-49352c741167 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:46:48.666462 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f133142-31bc-4dea-ae0f-49352c741167 service neutron] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:46:48.674439 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 611/1220] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 15:46:48 2022] GET /identity/v3/auth/tokens => generated 2879 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:46:51.900332 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c2d28-db65-4c3c-bf94-ce59c1f6ea90 None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:46:51.901309 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c2d28-db65-4c3c-bf94-ce59c1f6ea90 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:46:51.901309 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c2d28-db65-4c3c-bf94-ce59c1f6ea90 None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:46:51.902315 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 610/1221] 10.222.0.18 () {54 vars in 921 bytes} [Tue Jul 26 15:46:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 15:46:51.909315 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cbe77d-23cd-4125-804f-03b7dd2ac698 None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:46:51.911672 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cbe77d-23cd-4125-804f-03b7dd2ac698 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:46:51.911950 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cbe77d-23cd-4125-804f-03b7dd2ac698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:46:51.958733 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-27cbe77d-23cd-4125-804f-03b7dd2ac698 None None] MFA Rules not processed for user `fbc5f2b36d3f45f1b3c8155e46c46fda`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:46:51.961311 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-27cbe77d-23cd-4125-804f-03b7dd2ac698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:46:51.980377 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 612/1222] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Jul 26 15:46:51 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:46:52.011189 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938c2d28-db65-4c3c-bf94-ce59c1f6ea90 None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:46:52.041421 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938c2d28-db65-4c3c-bf94-ce59c1f6ea90 None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:46:52.052757 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb453883-5826-4c3e-a71f-84d647bcfe45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc5f2b36d3f45f1b3c8155e46c46fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9178e468facc41d6a7d828dfcd5301b4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:46:52.054133 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb453883-5826-4c3e-a71f-84d647bcfe45 service nova] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:46:52.055421 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb453883-5826-4c3e-a71f-84d647bcfe45 service nova] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:46:52.055932 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb453883-5826-4c3e-a71f-84d647bcfe45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:46:52.078751 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb453883-5826-4c3e-a71f-84d647bcfe45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:46:52.085371 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb453883-5826-4c3e-a71f-84d647bcfe45 service nova] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:46:52.113606 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 611/1223] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 15:46:52 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:47:01.945640 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=9 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:47:02.101172 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=6 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:48:32.543436 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da009c1-99b2-487e-9694-3da88c4dc01b None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:48:32.543993 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da009c1-99b2-487e-9694-3da88c4dc01b None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:48:32.543993 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da009c1-99b2-487e-9694-3da88c4dc01b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:48:32.574885 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-5da009c1-99b2-487e-9694-3da88c4dc01b None None] MFA Rules not processed for user `aed3fe46c30a45629eddc49c90fa6c1e`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:48:32.576134 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-5da009c1-99b2-487e-9694-3da88c4dc01b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:48:32.602771 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 613/1224] 10.222.0.18 () {58 vars in 958 bytes} [Tue Jul 26 15:48:32 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:48:32.927949 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d723ee48-9eeb-4719-b9f0-070d11c6db89 None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:48:32.928537 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d723ee48-9eeb-4719-b9f0-070d11c6db89 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:48:32.928537 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d723ee48-9eeb-4719-b9f0-070d11c6db89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:48:33.001051 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-d723ee48-9eeb-4719-b9f0-070d11c6db89 None None] MFA Rules not processed for user `960c230d1e8841e6b231fdbf4d172cc6`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:48:33.002331 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-d723ee48-9eeb-4719-b9f0-070d11c6db89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:48:33.034425 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 612/1225] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Jul 26 15:48:32 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:48:33.046088 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da009c1-99b2-487e-9694-3da88c4dc01b None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:48:33.056418 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da009c1-99b2-487e-9694-3da88c4dc01b None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:48:33.059984 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcf381f-755c-413f-85c8-fb189dd69f72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960c230d1e8841e6b231fdbf4d172cc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9178e468facc41d6a7d828dfcd5301b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:48:33.060614 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf381f-755c-413f-85c8-fb189dd69f72 service neutron] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:48:33.060893 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf381f-755c-413f-85c8-fb189dd69f72 service neutron] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:48:33.061187 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf381f-755c-413f-85c8-fb189dd69f72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:48:33.068935 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcf381f-755c-413f-85c8-fb189dd69f72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:48:33.070987 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcf381f-755c-413f-85c8-fb189dd69f72 service neutron] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:48:33.079085 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 614/1226] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 15:48:33 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:48:43.031568 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=33 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:48:43.075591 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=21 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:49:14.945885 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea4e6a-513a-44c1-99d3-7f4234a65cfe None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:49:14.946440 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea4e6a-513a-44c1-99d3-7f4234a65cfe None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:49:14.946440 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea4e6a-513a-44c1-99d3-7f4234a65cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:49:14.966351 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-ecea4e6a-513a-44c1-99d3-7f4234a65cfe None None] MFA Rules not processed for user `aed3fe46c30a45629eddc49c90fa6c1e`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:49:14.967613 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-ecea4e6a-513a-44c1-99d3-7f4234a65cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:49:14.974508 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 613/1227] 10.222.0.18 () {58 vars in 958 bytes} [Tue Jul 26 15:49:14 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:49:22.694188 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcf381f-755c-413f-85c8-fb189dd69f72 service neutron] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:49:22.727280 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcf381f-755c-413f-85c8-fb189dd69f72 service neutron] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:49:22.732545 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca60813-8834-4878-9f0c-068a7f7fdf20 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21a7f59ebf1b40a1b76ee2002ae38230', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9178e468facc41d6a7d828dfcd5301b4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:49:22.733194 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca60813-8834-4878-9f0c-068a7f7fdf20 service placement] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:49:22.733478 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca60813-8834-4878-9f0c-068a7f7fdf20 service placement] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:49:22.733755 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca60813-8834-4878-9f0c-068a7f7fdf20 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:49:22.743387 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca60813-8834-4878-9f0c-068a7f7fdf20 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:49:22.745083 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca60813-8834-4878-9f0c-068a7f7fdf20 service placement] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:49:22.756303 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 615/1228] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 15:49:22 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:49:24.960533 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=3 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:49:32.751564 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=13 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:49:39.768541 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6daf015-66a2-4456-b06f-e5353248289f None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:49:39.769089 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6daf015-66a2-4456-b06f-e5353248289f None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:49:39.769272 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6daf015-66a2-4456-b06f-e5353248289f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:49:39.789443 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-c6daf015-66a2-4456-b06f-e5353248289f None None] MFA Rules not processed for user `aed3fe46c30a45629eddc49c90fa6c1e`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:49:39.790764 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-c6daf015-66a2-4456-b06f-e5353248289f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:49:39.798015 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 614/1229] 10.222.0.18 () {58 vars in 958 bytes} [Tue Jul 26 15:49:39 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:49:49.784003 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=3 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:50:38.070168 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c5904-e546-4954-8b65-f735d3664e2e None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:50:38.070711 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c5904-e546-4954-8b65-f735d3664e2e None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:50:38.070711 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c5904-e546-4954-8b65-f735d3664e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:50:38.090122 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-382c5904-e546-4954-8b65-f735d3664e2e None None] MFA Rules not processed for user `74b8ef44c6824726b1eb069c6930a87e`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:50:38.091360 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-382c5904-e546-4954-8b65-f735d3664e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:50:38.099040 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 616/1230] 10.222.0.18 () {58 vars in 958 bytes} [Tue Jul 26 15:50:38 2022] POST /identity/v3/auth/tokens => generated 2812 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:50:48.084799 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=3 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:50:56.669866 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6daf015-66a2-4456-b06f-e5353248289f None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:50:56.690856 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382c5904-e546-4954-8b65-f735d3664e2e None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:50:56.691860 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6daf015-66a2-4456-b06f-e5353248289f None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:50:56.697056 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0154da39-dcba-4dc2-967a-89f0964c61e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc5f2b36d3f45f1b3c8155e46c46fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9178e468facc41d6a7d828dfcd5301b4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:50:56.697809 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0154da39-dcba-4dc2-967a-89f0964c61e3 service nova] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:50:56.698000 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0154da39-dcba-4dc2-967a-89f0964c61e3 service nova] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:50:56.698281 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0154da39-dcba-4dc2-967a-89f0964c61e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:50:56.707249 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0154da39-dcba-4dc2-967a-89f0964c61e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:50:56.708881 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0154da39-dcba-4dc2-967a-89f0964c61e3 service nova] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:50:56.718007 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 615/1231] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 15:50:56 2022] GET /identity/v3/auth/tokens => generated 2812 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:50:56.759667 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382c5904-e546-4954-8b65-f735d3664e2e None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:50:56.763743 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe146692-3623-4e61-be6e-a51e059ca756 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '279031fbf2114c11883018b0d41e243a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9178e468facc41d6a7d828dfcd5301b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:50:56.764379 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe146692-3623-4e61-be6e-a51e059ca756 service cinder] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:50:56.764667 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe146692-3623-4e61-be6e-a51e059ca756 service cinder] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:50:56.764965 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe146692-3623-4e61-be6e-a51e059ca756 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:50:56.774921 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe146692-3623-4e61-be6e-a51e059ca756 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:50:56.776454 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe146692-3623-4e61-be6e-a51e059ca756 service cinder] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:50:56.786841 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 617/1232] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 15:50:56 2022] GET /identity/v3/auth/tokens => generated 2804 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:51:06.713758 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=10 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:51:06.782333 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=30 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:51:09.311534 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0154da39-dcba-4dc2-967a-89f0964c61e3 service nova] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:51:09.321052 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0154da39-dcba-4dc2-967a-89f0964c61e3 service nova] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:51:09.325436 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dba600-402b-4278-a326-f26f89a39e4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960c230d1e8841e6b231fdbf4d172cc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9178e468facc41d6a7d828dfcd5301b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:51:09.326072 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dba600-402b-4278-a326-f26f89a39e4f service neutron] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:51:09.326356 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dba600-402b-4278-a326-f26f89a39e4f service neutron] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:51:09.326634 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dba600-402b-4278-a326-f26f89a39e4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:51:09.337441 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dba600-402b-4278-a326-f26f89a39e4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:51:09.338906 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dba600-402b-4278-a326-f26f89a39e4f service neutron] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:51:09.349384 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 616/1233] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 15:51:09 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:51:14.020091 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624719da-7b2d-412c-88d7-e013c8bf1e8d None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:51:14.020645 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624719da-7b2d-412c-88d7-e013c8bf1e8d None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:51:14.020796 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624719da-7b2d-412c-88d7-e013c8bf1e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:51:14.041774 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-624719da-7b2d-412c-88d7-e013c8bf1e8d None None] MFA Rules not processed for user `aed3fe46c30a45629eddc49c90fa6c1e`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:51:14.043013 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-624719da-7b2d-412c-88d7-e013c8bf1e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:51:14.051657 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 618/1234] 10.222.0.18 () {58 vars in 958 bytes} [Tue Jul 26 15:51:14 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:51:14.439716 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dba600-402b-4278-a326-f26f89a39e4f service neutron] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:51:14.448922 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dba600-402b-4278-a326-f26f89a39e4f service neutron] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:51:14.452726 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20532546-457d-4537-8f3c-b3a20a22100a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960c230d1e8841e6b231fdbf4d172cc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9178e468facc41d6a7d828dfcd5301b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:51:14.453352 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20532546-457d-4537-8f3c-b3a20a22100a service neutron] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:51:14.453831 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20532546-457d-4537-8f3c-b3a20a22100a service neutron] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:51:14.454279 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20532546-457d-4537-8f3c-b3a20a22100a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:51:14.463446 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20532546-457d-4537-8f3c-b3a20a22100a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:51:14.465171 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20532546-457d-4537-8f3c-b3a20a22100a service neutron] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:51:14.474294 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 617/1235] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 15:51:14 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:51:14.794090 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624719da-7b2d-412c-88d7-e013c8bf1e8d None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:51:14.806295 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624719da-7b2d-412c-88d7-e013c8bf1e8d None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:51:14.810847 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7637cd6a-b392-474a-b93f-17afc6de30d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960c230d1e8841e6b231fdbf4d172cc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9178e468facc41d6a7d828dfcd5301b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:51:14.811907 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7637cd6a-b392-474a-b93f-17afc6de30d9 service neutron] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:51:14.811907 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7637cd6a-b392-474a-b93f-17afc6de30d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:51:14.812150 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7637cd6a-b392-474a-b93f-17afc6de30d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:51:14.823936 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7637cd6a-b392-474a-b93f-17afc6de30d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:51:14.825880 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7637cd6a-b392-474a-b93f-17afc6de30d9 service neutron] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:51:14.837946 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 619/1236] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 15:51:14 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:51:15.388458 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20532546-457d-4537-8f3c-b3a20a22100a service neutron] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:51:15.404049 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20532546-457d-4537-8f3c-b3a20a22100a service neutron] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:51:15.409652 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4d228b-1a14-453a-a9d2-1f6a79dd0d77 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21a7f59ebf1b40a1b76ee2002ae38230', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9178e468facc41d6a7d828dfcd5301b4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:51:15.410312 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4d228b-1a14-453a-a9d2-1f6a79dd0d77 service placement] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:51:15.410602 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4d228b-1a14-453a-a9d2-1f6a79dd0d77 service placement] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:51:15.410981 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4d228b-1a14-453a-a9d2-1f6a79dd0d77 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:51:15.433780 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4d228b-1a14-453a-a9d2-1f6a79dd0d77 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:51:15.451543 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4d228b-1a14-453a-a9d2-1f6a79dd0d77 service placement] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:51:15.471542 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 618/1237] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 15:51:15 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:51:24.832480 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=9 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:51:25.466140 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=18 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:51:27.952160 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7637cd6a-b392-474a-b93f-17afc6de30d9 service neutron] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:51:27.962305 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7637cd6a-b392-474a-b93f-17afc6de30d9 service neutron] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:51:27.966304 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a64326-4e86-47b0-b7f4-1ae4c66f105e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960c230d1e8841e6b231fdbf4d172cc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9178e468facc41d6a7d828dfcd5301b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:51:27.967016 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a64326-4e86-47b0-b7f4-1ae4c66f105e service neutron] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:51:27.967329 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a64326-4e86-47b0-b7f4-1ae4c66f105e service neutron] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:51:27.967606 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a64326-4e86-47b0-b7f4-1ae4c66f105e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:51:27.976151 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a64326-4e86-47b0-b7f4-1ae4c66f105e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:51:27.978737 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a64326-4e86-47b0-b7f4-1ae4c66f105e service neutron] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:51:27.988507 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 620/1238] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 15:51:27 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:51:30.917545 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4d228b-1a14-453a-a9d2-1f6a79dd0d77 service placement] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:51:30.930502 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4d228b-1a14-453a-a9d2-1f6a79dd0d77 service placement] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:51:30.934339 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3131abd-5543-4528-bf30-f97987620b7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960c230d1e8841e6b231fdbf4d172cc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9178e468facc41d6a7d828dfcd5301b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:51:30.934972 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3131abd-5543-4528-bf30-f97987620b7d service neutron] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:51:30.936004 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3131abd-5543-4528-bf30-f97987620b7d service neutron] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:51:30.936004 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3131abd-5543-4528-bf30-f97987620b7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:51:30.946957 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3131abd-5543-4528-bf30-f97987620b7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:51:30.948476 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3131abd-5543-4528-bf30-f97987620b7d service neutron] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:51:30.958979 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 619/1239] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 15:51:30 2022] GET /identity/v3/auth/tokens => generated 2865 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:51:33.953398 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a64326-4e86-47b0-b7f4-1ae4c66f105e service neutron] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:51:33.970695 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a64326-4e86-47b0-b7f4-1ae4c66f105e service neutron] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:51:33.976952 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb3c1e5-bd96-4b4e-ba12-1aa8bfcada6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc5f2b36d3f45f1b3c8155e46c46fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9178e468facc41d6a7d828dfcd5301b4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:51:33.977406 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb3c1e5-bd96-4b4e-ba12-1aa8bfcada6c service nova] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:51:33.977693 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb3c1e5-bd96-4b4e-ba12-1aa8bfcada6c service nova] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:51:33.978088 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb3c1e5-bd96-4b4e-ba12-1aa8bfcada6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:51:33.993005 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb3c1e5-bd96-4b4e-ba12-1aa8bfcada6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:51:33.994672 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb3c1e5-bd96-4b4e-ba12-1aa8bfcada6c service nova] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:51:34.005657 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 621/1240] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 15:51:33 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:51:40.954361 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=6 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:51:44.001068 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=12 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:52:33.918119 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3131abd-5543-4528-bf30-f97987620b7d service neutron] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:52:33.931038 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3131abd-5543-4528-bf30-f97987620b7d service neutron] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:52:33.937496 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43194b5d-4cb4-4c06-bb9a-5bf34a259848 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc5f2b36d3f45f1b3c8155e46c46fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9178e468facc41d6a7d828dfcd5301b4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:52:33.938072 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43194b5d-4cb4-4c06-bb9a-5bf34a259848 service nova] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:52:33.938357 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43194b5d-4cb4-4c06-bb9a-5bf34a259848 service nova] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:52:33.938641 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43194b5d-4cb4-4c06-bb9a-5bf34a259848 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:52:33.952834 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43194b5d-4cb4-4c06-bb9a-5bf34a259848 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:52:33.952834 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43194b5d-4cb4-4c06-bb9a-5bf34a259848 service nova] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:52:33.960866 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 620/1241] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 15:52:33 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:52:36.057808 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb3c1e5-bd96-4b4e-ba12-1aa8bfcada6c service nova] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:52:36.069141 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb3c1e5-bd96-4b4e-ba12-1aa8bfcada6c service nova] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:52:36.074712 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9888379-00f4-4eb3-94fd-1591ccb62795 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960c230d1e8841e6b231fdbf4d172cc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9178e468facc41d6a7d828dfcd5301b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:52:36.075388 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9888379-00f4-4eb3-94fd-1591ccb62795 service neutron] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:52:36.075679 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9888379-00f4-4eb3-94fd-1591ccb62795 service neutron] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:52:36.075959 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9888379-00f4-4eb3-94fd-1591ccb62795 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:52:36.154249 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9888379-00f4-4eb3-94fd-1591ccb62795 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:52:36.156558 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9888379-00f4-4eb3-94fd-1591ccb62795 service neutron] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:52:36.178144 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 622/1242] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 15:52:36 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:52:40.645768 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1529342-dca8-4c29-8640-1d60e01cbeaa None None] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:52:40.646685 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1529342-dca8-4c29-8640-1d60e01cbeaa None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:52:40.646843 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1529342-dca8-4c29-8640-1d60e01cbeaa None None] PATH_INFO: `/` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:52:40.648898 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 621/1243] 10.222.0.18 () {54 vars in 921 bytes} [Tue Jul 26 15:52:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 15:52:40.661309 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eee499-e8fa-4c16-8209-8f19f6ae9077 None None] REQUEST_METHOD: `POST` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:52:40.661864 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eee499-e8fa-4c16-8209-8f19f6ae9077 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:52:40.662402 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eee499-e8fa-4c16-8209-8f19f6ae9077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:52:40.724367 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.auth.core [None req-43eee499-e8fa-4c16-8209-8f19f6ae9077 None None] MFA Rules not processed for user `21a7f59ebf1b40a1b76ee2002ae38230`. Rule list: `[]` (Enabled: `True`). {{(pid=87362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:52:40.725888 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-43eee499-e8fa-4c16-8209-8f19f6ae9077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:52:40.735281 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 623/1244] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Jul 26 15:52:40 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:52:40.746673 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1529342-dca8-4c29-8640-1d60e01cbeaa None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:52:40.762082 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1529342-dca8-4c29-8640-1d60e01cbeaa None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:52:40.768750 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796d2574-1946-462e-9663-40f86e633233 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21a7f59ebf1b40a1b76ee2002ae38230', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9178e468facc41d6a7d828dfcd5301b4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:52:40.769518 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796d2574-1946-462e-9663-40f86e633233 service placement] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:52:40.770170 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796d2574-1946-462e-9663-40f86e633233 service placement] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:52:40.770170 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796d2574-1946-462e-9663-40f86e633233 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:52:40.780462 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796d2574-1946-462e-9663-40f86e633233 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:52:40.782192 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796d2574-1946-462e-9663-40f86e633233 service placement] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:52:40.794741 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 622/1245] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 15:52:40 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:52:44.805578 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc8210-9997-4a8c-93b2-c5b6a5e4f847 None None] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:52:44.806160 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc8210-9997-4a8c-93b2-c5b6a5e4f847 None None] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:52:44.806160 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc8210-9997-4a8c-93b2-c5b6a5e4f847 None None] PATH_INFO: `/` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:52:44.807531 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 624/1246] 10.222.0.18 () {54 vars in 921 bytes} [Tue Jul 26 15:52:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 15:52:44.813156 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233e413f-49d6-4dab-be88-8cfba8ce7e37 None None] REQUEST_METHOD: `POST` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:52:44.813676 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233e413f-49d6-4dab-be88-8cfba8ce7e37 None None] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:52:44.825987 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233e413f-49d6-4dab-be88-8cfba8ce7e37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:52:44.837764 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.auth.core [None req-233e413f-49d6-4dab-be88-8cfba8ce7e37 None None] MFA Rules not processed for user `21a7f59ebf1b40a1b76ee2002ae38230`. Rule list: `[]` (Enabled: `True`). {{(pid=87363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:52:44.839023 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-233e413f-49d6-4dab-be88-8cfba8ce7e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:52:44.849129 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 623/1247] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Jul 26 15:52:44 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:52:44.862806 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fc8210-9997-4a8c-93b2-c5b6a5e4f847 None None] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:52:44.876762 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fc8210-9997-4a8c-93b2-c5b6a5e4f847 None None] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:52:44.883092 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d0e386-9457-410a-abfb-d79250b9ea02 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21a7f59ebf1b40a1b76ee2002ae38230', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9178e468facc41d6a7d828dfcd5301b4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:52:44.883751 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d0e386-9457-410a-abfb-d79250b9ea02 service placement] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:52:44.884034 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d0e386-9457-410a-abfb-d79250b9ea02 service placement] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:52:44.884420 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d0e386-9457-410a-abfb-d79250b9ea02 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:52:44.894204 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d0e386-9457-410a-abfb-d79250b9ea02 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:52:44.895881 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d0e386-9457-410a-abfb-d79250b9ea02 service placement] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:52:44.912593 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 625/1248] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 15:52:44 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:52:44.932024 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233e413f-49d6-4dab-be88-8cfba8ce7e37 None None] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:52:44.943291 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233e413f-49d6-4dab-be88-8cfba8ce7e37 None None] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:52:44.959843 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecc2e0d-a696-41a3-bced-c51d66a1cf86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1316e00006b74e70a667f12420c63a2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:52:44.959843 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc2e0d-a696-41a3-bced-c51d66a1cf86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:52:44.959843 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc2e0d-a696-41a3-bced-c51d66a1cf86 admin admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:52:44.959843 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc2e0d-a696-41a3-bced-c51d66a1cf86 admin admin] PATH_INFO: `/v3/users/74b8ef44c6824726b1eb069c6930a87e` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:52:44.966036 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecc2e0d-a696-41a3-bced-c51d66a1cf86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74b8ef44c6824726b1eb069c6930a87e)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:52:44.968621 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: WARNING py.warnings [None req-0ecc2e0d-a696-41a3-bced-c51d66a1cf86 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 15:52:44.968621 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: warnings.warn(msg) Jul 26 15:52:44.968621 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: Jul 26 15:52:44.970451 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecc2e0d-a696-41a3-bced-c51d66a1cf86 admin admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:52:45.219194 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.notifications [None req-0ecc2e0d-a696-41a3-bced-c51d66a1cf86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74b8ef44c6824726b1eb069c6930a87e'} {{(pid=87363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:52:45.230261 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.notifications [None req-0ecc2e0d-a696-41a3-bced-c51d66a1cf86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74b8ef44c6824726b1eb069c6930a87e'} {{(pid=87363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:52:45.402191 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.notifications [None req-0ecc2e0d-a696-41a3-bced-c51d66a1cf86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74b8ef44c6824726b1eb069c6930a87e'} {{(pid=87363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:52:45.402824 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.notifications [None req-0ecc2e0d-a696-41a3-bced-c51d66a1cf86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74b8ef44c6824726b1eb069c6930a87e'} {{(pid=87363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:52:45.424639 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.notifications [None req-0ecc2e0d-a696-41a3-bced-c51d66a1cf86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74b8ef44c6824726b1eb069c6930a87e'} {{(pid=87363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:52:45.430729 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 624/1249] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Jul 26 15:52:44 2022] DELETE /identity/v3/users/74b8ef44c6824726b1eb069c6930a87e => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:52:45.748583 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d0e386-9457-410a-abfb-d79250b9ea02 service placement] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:52:45.765102 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d0e386-9457-410a-abfb-d79250b9ea02 service placement] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:52:45.844460 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52afdce8-4821-4c8e-ac6d-41926987bb9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1316e00006b74e70a667f12420c63a2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:52:45.845115 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52afdce8-4821-4c8e-ac6d-41926987bb9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:52:45.845332 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52afdce8-4821-4c8e-ac6d-41926987bb9b admin admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:52:45.845587 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52afdce8-4821-4c8e-ac6d-41926987bb9b admin admin] PATH_INFO: `/v3/projects/ab39c21f7d694e5d8d01f78e0efc318f` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:52:45.846777 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52afdce8-4821-4c8e-ac6d-41926987bb9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab39c21f7d694e5d8d01f78e0efc318f)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:52:45.847841 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: WARNING py.warnings [None req-52afdce8-4821-4c8e-ac6d-41926987bb9b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 15:52:45.847841 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: warnings.warn(msg) Jul 26 15:52:45.847841 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: Jul 26 15:52:45.849089 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52afdce8-4821-4c8e-ac6d-41926987bb9b admin admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:52:46.040633 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:52:46.056489 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.notifications [None req-52afdce8-4821-4c8e-ac6d-41926987bb9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab39c21f7d694e5d8d01f78e0efc318f', 'request_id': 'req-52afdce8-4821-4c8e-ac6d-41926987bb9b'} {{(pid=87362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:52:46.179450 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.notifications [None req-52afdce8-4821-4c8e-ac6d-41926987bb9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab39c21f7d694e5d8d01f78e0efc318f', 'request_id': 'req-52afdce8-4821-4c8e-ac6d-41926987bb9b'} {{(pid=87362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:52:46.191071 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.notifications [None req-52afdce8-4821-4c8e-ac6d-41926987bb9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab39c21f7d694e5d8d01f78e0efc318f', 'request_id': 'req-52afdce8-4821-4c8e-ac6d-41926987bb9b'} {{(pid=87362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:52:46.221883 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.notifications [None req-52afdce8-4821-4c8e-ac6d-41926987bb9b admin admin] The token cache is being invalidate because project ab39c21f7d694e5d8d01f78e0efc318f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:52:46.222334 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.notifications [None req-52afdce8-4821-4c8e-ac6d-41926987bb9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:52:46.223271 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.notifications [None req-52afdce8-4821-4c8e-ac6d-41926987bb9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:52:46.225799 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 626/1250] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Jul 26 15:52:45 2022] DELETE /identity/v3/projects/ab39c21f7d694e5d8d01f78e0efc318f => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:52:46.230197 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecc2e0d-a696-41a3-bced-c51d66a1cf86 admin admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:52:46.231819 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-0ecc2e0d-a696-41a3-bced-c51d66a1cf86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:52:46.249045 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecc2e0d-a696-41a3-bced-c51d66a1cf86 admin admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:52:46.318866 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3016d55-91bc-4260-85e7-a4d5c99d3c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1316e00006b74e70a667f12420c63a2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:52:46.319481 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3016d55-91bc-4260-85e7-a4d5c99d3c59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:52:46.319765 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3016d55-91bc-4260-85e7-a4d5c99d3c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:52:46.320038 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3016d55-91bc-4260-85e7-a4d5c99d3c59 admin admin] PATH_INFO: `/v3/users/b38d0ada7b554dbe845f1f00ae464bc3` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:52:46.325401 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3016d55-91bc-4260-85e7-a4d5c99d3c59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b38d0ada7b554dbe845f1f00ae464bc3)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:52:46.327656 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3016d55-91bc-4260-85e7-a4d5c99d3c59 admin admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:52:46.595213 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:52:46.600761 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.notifications [None req-e3016d55-91bc-4260-85e7-a4d5c99d3c59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b38d0ada7b554dbe845f1f00ae464bc3'} {{(pid=87363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:52:46.607954 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.notifications [None req-e3016d55-91bc-4260-85e7-a4d5c99d3c59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b38d0ada7b554dbe845f1f00ae464bc3'} {{(pid=87363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:52:46.693726 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.notifications [None req-e3016d55-91bc-4260-85e7-a4d5c99d3c59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b38d0ada7b554dbe845f1f00ae464bc3'} {{(pid=87363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:52:46.694368 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.notifications [None req-e3016d55-91bc-4260-85e7-a4d5c99d3c59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b38d0ada7b554dbe845f1f00ae464bc3'} {{(pid=87363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:52:46.708369 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.notifications [None req-e3016d55-91bc-4260-85e7-a4d5c99d3c59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b38d0ada7b554dbe845f1f00ae464bc3'} {{(pid=87363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:52:46.714582 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 625/1251] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Jul 26 15:52:46 2022] DELETE /identity/v3/users/b38d0ada7b554dbe845f1f00ae464bc3 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:52:47.152888 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52afdce8-4821-4c8e-ac6d-41926987bb9b admin admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:52:47.154547 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-52afdce8-4821-4c8e-ac6d-41926987bb9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:52:47.167728 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52afdce8-4821-4c8e-ac6d-41926987bb9b admin admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:52:47.233699 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008593ce-e940-48b0-800c-f55ab4747e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1316e00006b74e70a667f12420c63a2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:52:47.234356 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008593ce-e940-48b0-800c-f55ab4747e84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:52:47.234640 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008593ce-e940-48b0-800c-f55ab4747e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:52:47.235014 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008593ce-e940-48b0-800c-f55ab4747e84 admin admin] PATH_INFO: `/v3/projects/f1341afbea16426c9c2e13f4f5ce9fcf` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:52:47.237600 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008593ce-e940-48b0-800c-f55ab4747e84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1341afbea16426c9c2e13f4f5ce9fcf)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:52:47.238137 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008593ce-e940-48b0-800c-f55ab4747e84 admin admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:52:47.397520 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.notifications [None req-008593ce-e940-48b0-800c-f55ab4747e84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1341afbea16426c9c2e13f4f5ce9fcf', 'request_id': 'req-008593ce-e940-48b0-800c-f55ab4747e84'} {{(pid=87362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:52:47.516631 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.notifications [None req-008593ce-e940-48b0-800c-f55ab4747e84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1341afbea16426c9c2e13f4f5ce9fcf', 'request_id': 'req-008593ce-e940-48b0-800c-f55ab4747e84'} {{(pid=87362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:52:47.523397 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.notifications [None req-008593ce-e940-48b0-800c-f55ab4747e84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1341afbea16426c9c2e13f4f5ce9fcf', 'request_id': 'req-008593ce-e940-48b0-800c-f55ab4747e84'} {{(pid=87362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:52:47.536144 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.notifications [None req-008593ce-e940-48b0-800c-f55ab4747e84 admin admin] The token cache is being invalidate because project f1341afbea16426c9c2e13f4f5ce9fcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:52:47.536430 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.notifications [None req-008593ce-e940-48b0-800c-f55ab4747e84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:52:47.537138 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.notifications [None req-008593ce-e940-48b0-800c-f55ab4747e84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:52:47.538808 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 627/1252] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Jul 26 15:52:47 2022] DELETE /identity/v3/projects/f1341afbea16426c9c2e13f4f5ce9fcf => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:52:56.835084 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=14,keystone:DELETE=4,keystone:INSERT=1 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:52:57.532841 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:DELETE=12,keystone:SELECT=67,keystone:INSERT=2 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:55:04.083319 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3016d55-91bc-4260-85e7-a4d5c99d3c59 admin admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:55:04.084900 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-e3016d55-91bc-4260-85e7-a4d5c99d3c59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:55:04.156054 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3016d55-91bc-4260-85e7-a4d5c99d3c59 admin admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:55:04.219224 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b6901f-80c8-446e-a276-462a639dfed1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21a7f59ebf1b40a1b76ee2002ae38230', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9178e468facc41d6a7d828dfcd5301b4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:55:04.219903 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b6901f-80c8-446e-a276-462a639dfed1 service placement] REQUEST_METHOD: `GET` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:55:04.220306 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b6901f-80c8-446e-a276-462a639dfed1 service placement] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:55:04.220591 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b6901f-80c8-446e-a276-462a639dfed1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:55:04.222412 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-12b6901f-80c8-446e-a276-462a639dfed1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:55:04.234859 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b6901f-80c8-446e-a276-462a639dfed1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:55:04.236526 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b6901f-80c8-446e-a276-462a639dfed1 service placement] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:55:04.246507 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 626/1253] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 15:55:04 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:55:14.242349 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=58 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:55:16.070619 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008593ce-e940-48b0-800c-f55ab4747e84 admin admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:55:16.072137 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-008593ce-e940-48b0-800c-f55ab4747e84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:55:16.130745 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008593ce-e940-48b0-800c-f55ab4747e84 admin admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:55:16.134383 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1235482-4e6c-40b5-a69e-3e69cb867a15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960c230d1e8841e6b231fdbf4d172cc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9178e468facc41d6a7d828dfcd5301b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:55:16.134927 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1235482-4e6c-40b5-a69e-3e69cb867a15 service neutron] REQUEST_METHOD: `GET` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:55:16.135245 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1235482-4e6c-40b5-a69e-3e69cb867a15 service neutron] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:55:16.135529 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1235482-4e6c-40b5-a69e-3e69cb867a15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:55:16.137277 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-f1235482-4e6c-40b5-a69e-3e69cb867a15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:55:16.201209 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1235482-4e6c-40b5-a69e-3e69cb867a15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:55:16.203277 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1235482-4e6c-40b5-a69e-3e69cb867a15 service neutron] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:55:16.213006 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 628/1254] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 15:55:16 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:55:23.925425 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b6901f-80c8-446e-a276-462a639dfed1 service placement] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:55:23.926945 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-12b6901f-80c8-446e-a276-462a639dfed1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:55:23.941431 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b6901f-80c8-446e-a276-462a639dfed1 service placement] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:55:23.946202 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb69ab9-0344-4556-9752-61172b3f7df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1316e00006b74e70a667f12420c63a2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:55:23.946846 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb69ab9-0344-4556-9752-61172b3f7df1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:55:23.947150 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb69ab9-0344-4556-9752-61172b3f7df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:55:23.947451 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb69ab9-0344-4556-9752-61172b3f7df1 admin admin] PATH_INFO: `/v3/users/aed3fe46c30a45629eddc49c90fa6c1e` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:55:23.948623 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb69ab9-0344-4556-9752-61172b3f7df1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aed3fe46c30a45629eddc49c90fa6c1e)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:55:23.950577 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb69ab9-0344-4556-9752-61172b3f7df1 admin admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:55:24.148881 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.notifications [None req-1eb69ab9-0344-4556-9752-61172b3f7df1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aed3fe46c30a45629eddc49c90fa6c1e'} {{(pid=87363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:55:24.156097 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.notifications [None req-1eb69ab9-0344-4556-9752-61172b3f7df1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aed3fe46c30a45629eddc49c90fa6c1e'} {{(pid=87363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:55:24.221600 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.notifications [None req-1eb69ab9-0344-4556-9752-61172b3f7df1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aed3fe46c30a45629eddc49c90fa6c1e'} {{(pid=87363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:55:24.222236 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.notifications [None req-1eb69ab9-0344-4556-9752-61172b3f7df1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aed3fe46c30a45629eddc49c90fa6c1e'} {{(pid=87363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:55:24.234869 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.notifications [None req-1eb69ab9-0344-4556-9752-61172b3f7df1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aed3fe46c30a45629eddc49c90fa6c1e'} {{(pid=87363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:55:24.240803 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 627/1255] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Jul 26 15:55:23 2022] DELETE /identity/v3/users/aed3fe46c30a45629eddc49c90fa6c1e => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:55:24.504353 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1235482-4e6c-40b5-a69e-3e69cb867a15 service neutron] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:55:24.516739 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1235482-4e6c-40b5-a69e-3e69cb867a15 service neutron] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:55:24.576475 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6142fed-2605-4dd9-ae2a-0873567c6108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1316e00006b74e70a667f12420c63a2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:55:24.577755 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6142fed-2605-4dd9-ae2a-0873567c6108 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:55:24.577985 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6142fed-2605-4dd9-ae2a-0873567c6108 admin admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:55:24.578212 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6142fed-2605-4dd9-ae2a-0873567c6108 admin admin] PATH_INFO: `/v3/projects/f3159d30c6044f70a32c1ad37791a71c` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:55:24.579492 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6142fed-2605-4dd9-ae2a-0873567c6108 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3159d30c6044f70a32c1ad37791a71c)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:55:24.581442 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6142fed-2605-4dd9-ae2a-0873567c6108 admin admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:55:24.732360 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.notifications [None req-b6142fed-2605-4dd9-ae2a-0873567c6108 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3159d30c6044f70a32c1ad37791a71c', 'request_id': 'req-b6142fed-2605-4dd9-ae2a-0873567c6108'} {{(pid=87362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:55:24.736024 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:55:24.817481 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.notifications [None req-b6142fed-2605-4dd9-ae2a-0873567c6108 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3159d30c6044f70a32c1ad37791a71c', 'request_id': 'req-b6142fed-2605-4dd9-ae2a-0873567c6108'} {{(pid=87362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:55:24.823787 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.notifications [None req-b6142fed-2605-4dd9-ae2a-0873567c6108 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3159d30c6044f70a32c1ad37791a71c', 'request_id': 'req-b6142fed-2605-4dd9-ae2a-0873567c6108'} {{(pid=87362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:55:24.835480 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.notifications [None req-b6142fed-2605-4dd9-ae2a-0873567c6108 admin admin] The token cache is being invalidate because project f3159d30c6044f70a32c1ad37791a71c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:55:24.835768 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.notifications [None req-b6142fed-2605-4dd9-ae2a-0873567c6108 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:55:24.836432 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.notifications [None req-b6142fed-2605-4dd9-ae2a-0873567c6108 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:55:24.837995 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 629/1256] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Jul 26 15:55:24 2022] DELETE /identity/v3/projects/f3159d30c6044f70a32c1ad37791a71c => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:55:24.842178 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb69ab9-0344-4556-9752-61172b3f7df1 admin admin] Authenticating user token {{(pid=87363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:55:24.843728 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.fernet_utils [None req-1eb69ab9-0344-4556-9752-61172b3f7df1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:55:24.856957 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb69ab9-0344-4556-9752-61172b3f7df1 admin admin] Validating token access rules against request {{(pid=87363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:55:24.912323 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5ba800-24fa-486c-ba43-3fab3d8a593d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1316e00006b74e70a667f12420c63a2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:55:24.934544 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ba800-24fa-486c-ba43-3fab3d8a593d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:55:24.934544 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ba800-24fa-486c-ba43-3fab3d8a593d admin admin] SCRIPT_NAME: `/identity` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:55:24.934544 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ba800-24fa-486c-ba43-3fab3d8a593d admin admin] PATH_INFO: `/v3/users/29c655c68dbc49e9b5a6ca4ab460f40b` {{(pid=87363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:55:24.934544 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5ba800-24fa-486c-ba43-3fab3d8a593d admin admin] RBAC: Authorizing `identity:delete_user(user_id=29c655c68dbc49e9b5a6ca4ab460f40b)` {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:55:24.934544 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5ba800-24fa-486c-ba43-3fab3d8a593d admin admin] RBAC: Authorization granted {{(pid=87363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:55:25.309747 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.notifications [None req-4f5ba800-24fa-486c-ba43-3fab3d8a593d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29c655c68dbc49e9b5a6ca4ab460f40b'} {{(pid=87363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:55:25.317931 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.notifications [None req-4f5ba800-24fa-486c-ba43-3fab3d8a593d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29c655c68dbc49e9b5a6ca4ab460f40b'} {{(pid=87363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:55:25.440314 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.notifications [None req-4f5ba800-24fa-486c-ba43-3fab3d8a593d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29c655c68dbc49e9b5a6ca4ab460f40b'} {{(pid=87363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:55:25.440945 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.notifications [None req-4f5ba800-24fa-486c-ba43-3fab3d8a593d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29c655c68dbc49e9b5a6ca4ab460f40b'} {{(pid=87363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:55:25.449488 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:55:25.454452 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG keystone.notifications [None req-4f5ba800-24fa-486c-ba43-3fab3d8a593d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29c655c68dbc49e9b5a6ca4ab460f40b'} {{(pid=87363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:55:25.460381 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: [pid: 87363|app: 0|req: 628/1257] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Jul 26 15:55:24 2022] DELETE /identity/v3/users/29c655c68dbc49e9b5a6ca4ab460f40b => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:55:25.712378 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6142fed-2605-4dd9-ae2a-0873567c6108 admin admin] Authenticating user token {{(pid=87362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:55:25.714076 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.fernet_utils [None req-b6142fed-2605-4dd9-ae2a-0873567c6108 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:55:25.730064 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6142fed-2605-4dd9-ae2a-0873567c6108 admin admin] Validating token access rules against request {{(pid=87362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:55:25.789350 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13ce2b6-eb42-4254-b0b8-b27a32b7b8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18673fd27512449ab07302f33ac3c310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1316e00006b74e70a667f12420c63a2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:55:25.789917 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ce2b6-eb42-4254-b0b8-b27a32b7b8a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:55:25.790208 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ce2b6-eb42-4254-b0b8-b27a32b7b8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:55:25.790489 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ce2b6-eb42-4254-b0b8-b27a32b7b8a3 admin admin] PATH_INFO: `/v3/projects/0d3c7307025f4027807d52b5946c973c` {{(pid=87362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:55:25.791706 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13ce2b6-eb42-4254-b0b8-b27a32b7b8a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d3c7307025f4027807d52b5946c973c)` {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:55:25.793640 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13ce2b6-eb42-4254-b0b8-b27a32b7b8a3 admin admin] RBAC: Authorization granted {{(pid=87362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:55:25.924782 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.notifications [None req-c13ce2b6-eb42-4254-b0b8-b27a32b7b8a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d3c7307025f4027807d52b5946c973c', 'request_id': 'req-c13ce2b6-eb42-4254-b0b8-b27a32b7b8a3'} {{(pid=87362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:55:26.032745 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.notifications [None req-c13ce2b6-eb42-4254-b0b8-b27a32b7b8a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d3c7307025f4027807d52b5946c973c', 'request_id': 'req-c13ce2b6-eb42-4254-b0b8-b27a32b7b8a3'} {{(pid=87362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:55:26.039103 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.notifications [None req-c13ce2b6-eb42-4254-b0b8-b27a32b7b8a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d3c7307025f4027807d52b5946c973c', 'request_id': 'req-c13ce2b6-eb42-4254-b0b8-b27a32b7b8a3'} {{(pid=87362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:55:26.051348 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.notifications [None req-c13ce2b6-eb42-4254-b0b8-b27a32b7b8a3 admin admin] The token cache is being invalidate because project 0d3c7307025f4027807d52b5946c973c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:55:26.051570 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.notifications [None req-c13ce2b6-eb42-4254-b0b8-b27a32b7b8a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:55:26.052226 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG keystone.notifications [None req-c13ce2b6-eb42-4254-b0b8-b27a32b7b8a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:55:26.053753 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: [pid: 87362|app: 0|req: 630/1258] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Jul 26 15:55:25 2022] DELETE /identity/v3/projects/0d3c7307025f4027807d52b5946c973c => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:55:35.725811 dv-osbrick-836062-12-ceph devstack@keystone.service[87363]: DEBUG dbcounter [-] [87363] Writing DB stats keystone:SELECT=3,keystone:DELETE=1 {{(pid=87363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:55:36.048034 dv-osbrick-836062-12-ceph devstack@keystone.service[87362]: DEBUG dbcounter [-] [87362] Writing DB stats keystone:DELETE=10,keystone:SELECT=57,keystone:INSERT=1 {{(pid=87362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}